-- Logs begin at Fri 2022-08-05 04:23:20 UTC, end at Fri 2022-08-05 05:31:45 UTC. -- Aug 05 05:01:59.470340 dv-cinder-815582-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 05 05:01:59.480512 dv-cinder-815582-14-smb devstack@keystone.service[80312]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 05:01:59 2022] *** Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: nodename: dv-cinder-815582-14-smb Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: machine: x86_64 Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: clock source: unix Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: pcre jit disabled Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: detected number of CPU cores: 4 Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: current working directory: / Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: detected binary path: /usr/bin/uwsgi-core Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: your processes number limit is 47680 Aug 05 05:01:59.483539 dv-cinder-815582-14-smb devstack@keystone.service[80312]: your memory page size is 4096 bytes Aug 05 05:01:59.484174 dv-cinder-815582-14-smb devstack@keystone.service[80312]: detected max file descriptor number: 2048 Aug 05 05:01:59.484174 dv-cinder-815582-14-smb devstack@keystone.service[80312]: lock engine: pthread robust mutexes Aug 05 05:01:59.484174 dv-cinder-815582-14-smb devstack@keystone.service[80312]: thunder lock: enabled Aug 05 05:01:59.484174 dv-cinder-815582-14-smb devstack@keystone.service[80312]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 05 05:01:59.484174 dv-cinder-815582-14-smb devstack@keystone.service[80312]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 05:01:59.526812 dv-cinder-815582-14-smb devstack@keystone.service[80312]: Python main interpreter initialized at 0x55ebd36fb9c0 Aug 05 05:01:59.526812 dv-cinder-815582-14-smb devstack@keystone.service[80312]: python threads support enabled Aug 05 05:01:59.526812 dv-cinder-815582-14-smb devstack@keystone.service[80312]: your server socket listen backlog is limited to 100 connections Aug 05 05:01:59.526812 dv-cinder-815582-14-smb devstack@keystone.service[80312]: your mercy for graceful operations on workers is 90 seconds Aug 05 05:01:59.527266 dv-cinder-815582-14-smb devstack@keystone.service[80312]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 05:01:59.527266 dv-cinder-815582-14-smb devstack@keystone.service[80312]: *** Operational MODE: preforking *** Aug 05 05:01:59.527521 dv-cinder-815582-14-smb devstack@keystone.service[80312]: *** uWSGI is running in multiple interpreter mode *** Aug 05 05:01:59.527521 dv-cinder-815582-14-smb devstack@keystone.service[80312]: spawned uWSGI master process (pid: 80312) Aug 05 05:01:59.527728 dv-cinder-815582-14-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 05 05:01:59.528707 dv-cinder-815582-14-smb devstack@keystone.service[80312]: spawned uWSGI worker 1 (pid: 80352, cores: 1) Aug 05 05:01:59.529020 dv-cinder-815582-14-smb devstack@keystone.service[80312]: spawned uWSGI worker 2 (pid: 80353, cores: 1) Aug 05 05:01:59.531983 dv-cinder-815582-14-smb devstack@keystone.service[80312]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 05:02:05.024440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:02:05.024440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: from cryptography.utils import int_from_bytes Aug 05 05:02:05.025286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:02:05.025286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: from cryptography.utils import int_from_bytes Aug 05 05:02:05.073710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 05:02:05.073900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 05:02:05.074091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] command line args: [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 05:02:05.074611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 05:02:05.074786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ================================================================================ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 05:02:05.075035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] admin_token = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.075402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_dir = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.075728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.076049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_source = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.076377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] debug = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.076716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_config_append = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_dir = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.080869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.081212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.081212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.081212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.081212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.081399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.081708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.082128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.083295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.083872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.084038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:02:05.084038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: from cryptography.utils import int_from_bytes Aug 05 05:02:05.084581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] publish_errors = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.084581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.084711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:02:05.084711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: from cryptography.utils import int_from_bytes Aug 05 05:02:05.084830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.084830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.084971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.085131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.085367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] standard_threads = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.085600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.085842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.086019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.086193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_journal = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.086367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_json = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.086540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_stderr = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.086715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_syslog = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.086944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.087228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.087467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.087725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.087963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.088208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.088442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.088686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.088920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.089162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.089404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.089649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.089879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.090120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.090357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.090599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.090841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.091074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.091352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.091603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.091844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.092076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.092324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.092578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.092826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.093070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.093297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.093524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.093749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.093980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.094225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.094467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.094691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.094916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.095182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.095423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.095655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.095897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.096125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.096357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.096587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.096812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.097043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.097271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.097499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.097733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.098007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.098244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.098476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.098703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.098935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.099183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.099431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.099660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.099894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.100126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.100369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.100601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.100833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.101058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.101304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.101536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.101769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.101996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.102251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.102485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.102713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.102945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.103200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.103469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.103702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.103946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.104188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.104421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.104656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.104888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.105132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.105363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.105595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.105832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.106062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.106293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.106524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.106754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.106987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.107271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.107509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.107746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.107979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.108216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.108449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.108681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.108911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.109138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.109647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.109882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.110129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.110356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.110594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.110828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.111072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.111329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.111584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.111841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.112079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.112306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.external = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.112531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.112822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.113050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.113278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.password = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.113505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.token = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.113764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.113997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.114239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.114466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.114709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.114952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.115196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.115431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.115672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.115917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.116158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.116389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.116626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.116857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.117117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.117368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.117604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.117854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.118133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.118375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.118634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.118870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.119122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.119379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.119611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.119852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.120092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.120317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.120558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.120788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.121036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.121269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.121519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.121751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.121994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.122227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.122470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.122713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.122945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.123195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.123441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.123668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.123901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.124145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.124392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.124620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.124845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.125072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.125311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.125560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.126524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.126524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.126524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.126524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.126782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.126964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.127212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.127447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.127673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.127913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.128148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.128384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.128628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.128857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.129110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.129850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.130086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.130324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.130739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.130974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.131241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.131472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.131707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.131939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.132178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.132411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.132643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.132888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.133132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.133209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 05:02:05.133340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 05:02:05.133419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.133536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] command line args: [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 05:02:05.133613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.133804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.133882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 05:02:05.133983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ================================================================================ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 05:02:05.134060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.134240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] admin_token = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.134317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.134483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.134565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_dir = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.134671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.134749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.134854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_source = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.134932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.135036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] debug = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.135149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.135275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.135426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.135506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.135656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.135734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.135899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.135981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.136141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.136219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.136369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.136453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.136592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_config_append = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.136668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.136738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.136816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.136889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_dir = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.137034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.137116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.137267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.137354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.137500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.137618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.137729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.137809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.137968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.138048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.138143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.138229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.138310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.138433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.138548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.138795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.138873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.139030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.139109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.139286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.139369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.139522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.139601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.139754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.139831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.139983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.140062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.140218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.140302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.140448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.140526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.140689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.140932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.141013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.141145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] publish_errors = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.141230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.141380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.141459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.141612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.141690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.141792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.141874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.142028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.142115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.142262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.142341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.142497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] standard_threads = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.142654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.142731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.142811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.142960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.143040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.143135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.143257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.143330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_journal = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.143414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.143495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_json = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.143655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.143735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_stderr = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.143828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_syslog = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.143905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.144059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:02:05.144139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.144314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.144550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.144678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.144808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.145575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.146909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.147895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.148867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.149976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.150943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.151958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.152913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.153992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.154927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.155941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.156870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.157951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.158966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159226 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.159910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.160934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161211 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.161966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.162967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.163892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 05:02:05.164768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.164934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.165171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.165405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.165640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.165874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.166135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.166379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.166624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.166862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.167103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.167373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.167608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.167842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.168094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.168301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.168530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.168763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.168993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.169232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.169468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.170081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.170081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.170264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.170422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.170665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.170896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.external = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.171125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.171445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.171676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.171906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.password = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.172138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.token = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.172378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.172614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.172858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.173090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.173337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.173582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.173812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.174053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.174298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.174546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.174791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.175024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.175290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.175526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.175785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.176036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.176861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.177129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.177417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.177668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.177934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.178178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.178438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.178673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.178911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.179194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.179422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.179652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.179898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.180137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.180392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.180628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.180882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.181119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.181378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.181615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.181872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.182119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.182356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.182592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.182839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.183072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.183332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.183583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.183834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.184067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.184301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.184531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.184776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.185022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.185268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.185524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.185769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.186038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.186275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.186511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.186754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.186976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.187233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.187471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.187710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.187949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.188194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.188427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.188672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.188918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.189152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.189396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.189638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.189866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.190100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.190329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.190564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.190797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.191039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.191296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.191532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.192739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.193009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.193246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.193478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.193728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.193975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.194213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.194302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.194450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.194543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.194672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.194770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.194909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.195148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.195428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.195659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.195905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.196150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.196395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.196630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.196859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.197093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.197326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.197558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.197787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.198032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.198275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.198518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.198762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.199003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.199519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.199766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.200001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.200234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.200467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.200699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.200944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.201190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.201426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.201676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.201905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.202148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.202383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.202617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.202853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.203090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.203253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.203501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.203735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.203973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.204216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.204463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.204712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.204946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.205195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.205445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.205681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.205926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.206160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.206400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.206634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.206878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.207107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.208119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.208726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.208985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.209241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.209495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.209746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.209996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.210244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.210481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.210730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.210977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.211247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.211497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.211918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.212155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.212406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.212657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.212905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.213157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.213394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.213650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.213902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.214141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.214372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.214604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.214842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.215094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.215375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.215624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.215861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.216097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.216326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.216563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.216798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.217043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.217277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.217534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.217781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.218020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.218262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.218507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.218753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.218988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.219252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.219490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.219734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.219980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.220209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.220452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.220746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.221006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.221251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.221498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.221735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.221977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.222213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.222450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.222684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.222920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.223667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.223914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.224163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.224408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.224657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.224898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.225143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.225374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.225613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.225847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:02:05.226018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 05:02:05.232638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.232868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.251300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.251532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.251757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.261029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.281007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.281188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.285364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.319422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.335625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.335857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.356129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.356364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.398895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.399117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.399365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.399585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.399799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.399882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.400010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.400093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.400273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.400495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.400711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.400922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.423130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.423379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.423597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.423698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.423814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.423897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.424874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.435801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.436562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.448619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.448870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.449105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.449582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.449667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.449795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.449878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.450863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 05:02:05.467648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.467793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.467879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 05:02:05.468006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 05:02:05.468175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.468341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.468426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 05:02:05.468540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 05:02:05.468624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.468805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.468897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.469060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.469142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.469313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.469395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.469565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.479102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.479400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.479667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.479825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.479945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.480105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.480379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.480657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.486732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.487491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.491895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.492171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.492447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.492725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.493247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.493987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.494070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.494252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.494332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.494509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.494597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.494778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.495048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.495337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.495608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.495871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.517376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.518832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.519034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.519117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.521574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.521856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.524224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.524500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.524774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.526429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.526708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.526989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.531327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.531556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.533509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.533790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.536185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.536502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.536817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.537103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.537380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.537653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.537922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.538193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.539032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.539346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.539630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.539927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.540200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.540490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.540757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.541028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.553957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.554235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.557240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.557520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.558095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.561249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.561423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.561543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.564550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.564844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.565862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.569173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.569736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.572307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.572604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.572884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.573167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.573252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.573785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.574066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.576633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.576935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.577217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.577505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.577778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.578051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.590704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.590984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.591267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.591534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.594996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.595309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.595579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.595841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.599058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.600890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.601165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.603790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.604022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.604298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.604585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.604863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.605136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.605334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.605611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.608406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.608688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.608990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.609270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.609550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.616801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.617077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.617348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.617619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.617890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.618160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.618437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.621379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.621657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.621933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.622219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.622502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.622783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.623055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.634422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.637372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.639472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.640284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.642391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.642678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.644201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.644489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.644774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.646091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.648621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.650118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.650403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.650680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.652046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.653624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.656531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.656817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.657074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.657176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.657348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.658663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.662056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.662341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.662623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.662902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.665294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.665580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.665853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.670847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.671130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.671430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.672644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.672919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.673193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.673461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.673726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.673989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.674257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.674534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.674913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.675198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.675471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.675727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.675996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.676301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.678763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 05:02:05.679037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.679341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.679615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.679885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.680153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.680428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.680697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.681074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.681358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.681630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.681900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.682164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.682424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 05:02:05.710602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebd36fb9c0 pid: 80353 (default app) Aug 05 05:02:05.713863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5ba7-6ab2-4204-8152-0b5edc9982c4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:05.714151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5ba7-6ab2-4204-8152-0b5edc9982c4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:05.714421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5ba7-6ab2-4204-8152-0b5edc9982c4 None None] PATH_INFO: `/v3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:05.717671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebd36fb9c0 pid: 80352 (default app) Aug 05 05:02:05.719282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Aug 5 05:02:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:13.266399 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:13.266942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:13.266942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:13.271693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:13.276770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:13.277195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:13.277314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:13.347055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: INFO dbcounter [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] Registered counter for database keystone Aug 05 05:02:13.367618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG oslo_db.sqlalchemy.engines [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80353) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:02:13.373707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writer thread running {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:02:13.549596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG passlib.handlers.bcrypt [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80353) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 05:02:13.549922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG passlib.handlers.bcrypt [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80353) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 05:02:13.605358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:13.606931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:13.734754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 05:02:13.860852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:13.929381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: INFO dbcounter [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] Registered counter for database keystone Aug 05 05:02:13.950761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG oslo_db.sqlalchemy.engines [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:02:13.956816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writer thread running {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:02:14.080290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27595dd-5c5c-4b93-843e-b264f676f741 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:14.086471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:14.087106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:14.087414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:14.087685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:14.095694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:14.148410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 05:02:14.148745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014b5f5-9177-42b5-9fd4-95da4a0a9fc2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:14.158218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Aug 5 05:02:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 05:02:14.164300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:14.178962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148dc1e-f2e3-410b-989a-5f7339fbaab4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:14.183462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:14.185052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:14.185340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:14.185615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] PATH_INFO: `/v3/projects/7c86c1e82858454b999fb55324c5aeed` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:14.187078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c86c1e82858454b999fb55324c5aeed)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:14.241368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 05:02:14.241695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926d0a7-32ca-4f7c-b293-fb759a40cdd9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:14.246300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Aug 5 05:02:14 2022] GET /identity/v3/projects/7c86c1e82858454b999fb55324c5aeed => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:16.234649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3fa9f-65ed-430f-bea3-e9441b1d7f31 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:16.235122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3fa9f-65ed-430f-bea3-e9441b1d7f31 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:16.235233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3fa9f-65ed-430f-bea3-e9441b1d7f31 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:16.239969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:16.245281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:16.245660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:16.245841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:16.265462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:16.266970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:16.275133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 05:02:16.297230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3fa9f-65ed-430f-bea3-e9441b1d7f31 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:16.309942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3fa9f-65ed-430f-bea3-e9441b1d7f31 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:16.314037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66321217-018e-4090-9768-2c7685699cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:16.314639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66321217-018e-4090-9768-2c7685699cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:16.314923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66321217-018e-4090-9768-2c7685699cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:16.315224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66321217-018e-4090-9768-2c7685699cbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:16.323133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66321217-018e-4090-9768-2c7685699cbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:16.325198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66321217-018e-4090-9768-2c7685699cbf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:16.334127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Aug 5 05:02:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:02:16.339371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:16.348960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183f75-0871-4789-9ce4-0aa83ad53afa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:16.353363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8afb-87ce-40a3-91d4-7d5d75633039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:16.353990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8afb-87ce-40a3-91d4-7d5d75633039 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:16.354273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8afb-87ce-40a3-91d4-7d5d75633039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:16.354547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8afb-87ce-40a3-91d4-7d5d75633039 admin admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:16.355916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8afb-87ce-40a3-91d4-7d5d75633039 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:16.357745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8afb-87ce-40a3-91d4-7d5d75633039 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:16.359285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Aug 5 05:02:16 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:18.417389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e05d-fa55-45bd-97e1-0796326c132f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.417919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e05d-fa55-45bd-97e1-0796326c132f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.418013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e05d-fa55-45bd-97e1-0796326c132f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.419482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:18.424527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.424914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.425191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.444690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:18.445864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:18.509736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3949c-fc82-4dd0-8268-93e2015baa81 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.510024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3949c-fc82-4dd0-8268-93e2015baa81 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.510302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3949c-fc82-4dd0-8268-93e2015baa81 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.511677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:18.516667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.516956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.517239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.528149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:18.552221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:18.560292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG passlib.handlers.bcrypt [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80352) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 05:02:18.560728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG passlib.handlers.bcrypt [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80352) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 05:02:18.575440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:18.606607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:18.608226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:18.654206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157e6b2-ea1b-468c-8382-cb7f1f20d2d3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:18.688316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:18.688884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.689162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.689433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.700517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:18.707228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:18.709403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:18.710495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:18.711371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:18.716667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:18.729614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:18.812003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:18.821920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113839-a55a-4094-9fc4-d6cd764fe7e3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:18.826193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:18.839266 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af47c-2577-4fb8-b4dd-ea531bcd56cb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:18.860697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:18.861565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.861855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.862131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.863021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:18.863861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:18.865282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:18.873264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:18.873887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:18.874162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:18.874433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:18.876983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:18.883011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:18.955910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:18.958219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:18.993664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7001ed8-9945-4078-b0f7-874db98d14bf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:19.031277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:19.032233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:19.032520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:19.032781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:19.034298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:19.035923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:19.037714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 9/16] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:18 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:19.044706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:19.085318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:19.159895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70808262-4a51-4508-8b19-e825a9a90a45 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:19.188340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:19.198509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:19.199438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:19.199720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:19.199988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:19.201536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:19.203543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:19.205130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 10/17] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:19.210336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 8/18] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 05:02:19.210862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:19.215913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:19.320910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03d236-45cc-4756-b1e1-a65a4b24e90a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:19.322441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:19.324045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4d09a-2c30-4bed-abd7-dd275817747d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:19.358215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:19.358839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:19.359126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:19.359440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:19.359641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:19.360238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.domain.id=default, user.id=2e4c5eb5f64b47918bbb844c3d24e88a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:19.360327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:19.360548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:19.360692 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:19.360963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:19.362000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:19.371930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 11/19] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Aug 5 05:02:19 2022] GET /identity/v3/role_assignments?user.id=2e4c5eb5f64b47918bbb844c3d24e88a&scope.domain.id=default&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:19.376648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:19.378466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-37f39654-ff80-4720-8573-994d71c720ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:02:19.397679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:19.398656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:19.399606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:02:19.399606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:02:19.399606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:02:19.399606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:19.399606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 9/20] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:19.409411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:19.524379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a94c2-14d5-441b-a194-cf30b2191163 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:19.559485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:19.560108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:19.560392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:19.560665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:19.561355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:19.561709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:19.563090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96e564-015f-4244-aef9-316e32eb4367 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:19.584829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 12/21] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:21.468274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e31a-dc99-4331-8ae3-6141c0cce794 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:21.469081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e31a-dc99-4331-8ae3-6141c0cce794 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:21.469489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e31a-dc99-4331-8ae3-6141c0cce794 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:21.470973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 10/22] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:21.477221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:21.478005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:21.478423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:21.504702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:21.506161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:21.532329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:21.601131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:21.635232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10e31a-dc99-4331-8ae3-6141c0cce794 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:21.677981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:21.760923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10e31a-dc99-4331-8ae3-6141c0cce794 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:21.808224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbabc59-5c42-4f3b-875e-f8a590facb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:21.809253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbabc59-5c42-4f3b-875e-f8a590facb39 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:21.809740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbabc59-5c42-4f3b-875e-f8a590facb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:21.810222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbabc59-5c42-4f3b-875e-f8a590facb39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:21.823403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbabc59-5c42-4f3b-875e-f8a590facb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6bbabc59-5c42-4f3b-875e-f8a590facb39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:21.828890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:21.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:21.830471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:21.837597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 11/24] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:21.839122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:22.012245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5010c-2773-41db-bca0-ea7592e59ce3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:22.023900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe47dc-234a-4601-bad4-e512ed09fe40 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.024538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe47dc-234a-4601-bad4-e512ed09fe40 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.025027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe47dc-234a-4601-bad4-e512ed09fe40 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.026581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 12/25] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:22.032972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b72b6-31da-42af-abb9-d20fafb30d9b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.033543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b72b6-31da-42af-abb9-d20fafb30d9b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.034734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b72b6-31da-42af-abb9-d20fafb30d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.065407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ec0b72b6-31da-42af-abb9-d20fafb30d9b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:22.068395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ec0b72b6-31da-42af-abb9-d20fafb30d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:22.085769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:22.086485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.086772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.087046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.087799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:22.088126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:22.090270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:22.100488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 14/26] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:22.106772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:22.139537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:22.264871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4aba-7469-403e-991b-5a9cac584f70 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:22.322007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:22.324056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baec8f-5fca-4606-aae6-df7a396cdf10 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.324766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baec8f-5fca-4606-aae6-df7a396cdf10 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.325219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baec8f-5fca-4606-aae6-df7a396cdf10 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.327335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 14/28] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:22.333955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.334404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.334856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.406495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:22.407736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:22.460423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:22.512933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:22.514962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.522243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.522994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.525372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:22.528531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:22.531600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:22 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:22.533352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:22.587185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 15/30] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:22.587185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:22.711533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:22.720211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2535-e715-4de9-9db7-c37f25631349 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:22.760647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:22.761394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.761678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.761953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.762922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:22.764844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:22.798518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d346-8bf1-4e3f-b084-03d1e1135dfa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:22.868593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:22.869235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:22.869516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:22.869785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:22.870935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:22.872453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:22.874249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:22.874844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:22.915852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:22.970845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 16/32] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 05:02:22 2022] POST /identity/v3/roles => generated 219 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:22.976298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:23.061285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81bb0-2ff4-4c30-9384-f4bd2734043e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:23.096620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db07624-361c-4615-aea8-f861c19d896e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:23.140187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315fe56-5f15-4952-8ffe-ea864fb22b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:23.140870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fe56-5f15-4952-8ffe-ea864fb22b2e None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.141152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fe56-5f15-4952-8ffe-ea864fb22b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.141426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fe56-5f15-4952-8ffe-ea864fb22b2e None admin] PATH_INFO: `/v3/domains/default/users/2e4c5eb5f64b47918bbb844c3d24e88a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.144582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fe56-5f15-4952-8ffe-ea864fb22b2e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2e4c5eb5f64b47918bbb844c3d24e88a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:23.146481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fe56-5f15-4952-8ffe-ea864fb22b2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:23.151528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:23.152201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.152477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.152746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.173845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:23.175593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:23.186255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 17/33] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Aug 5 05:02:22 2022] PUT /identity/v3/domains/default/users/2e4c5eb5f64b47918bbb844c3d24e88a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:23.188081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eef25-24f4-4bae-a50c-05dcf09d2b56 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.188528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eef25-24f4-4bae-a50c-05dcf09d2b56 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.188943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eef25-24f4-4bae-a50c-05dcf09d2b56 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.195822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 18/34] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:23.203075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.203389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.203710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:02:23.209762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:23.210764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:23.211770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:02:23.211770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:02:23.211770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:02:23.211770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:23.213295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:23.218675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:23.220807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:23.227061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:23.228664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:23.309741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 19/36] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:23.327245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:23.358539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:23.369380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53048920-319e-4073-a1b7-df8e32022735 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:23.424028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:23.425125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.425761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.426303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.427207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:23.427812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:23.429471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:23.459528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 18/37] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:23.464874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:23.475631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6058e-af30-40d7-9ced-4e17c677f085 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:23.533918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422f2de-658b-4597-ab91-97d8c9dc8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:23.535935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f2de-658b-4597-ab91-97d8c9dc8fbc None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.536357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f2de-658b-4597-ab91-97d8c9dc8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.536751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f2de-658b-4597-ab91-97d8c9dc8fbc None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.537602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f2de-658b-4597-ab91-97d8c9dc8fbc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:23.539148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f2de-658b-4597-ab91-97d8c9dc8fbc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:23.543733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:23.561709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 05:02:23 2022] POST /identity/v3/roles => generated 225 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:23.563655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75955-1fc4-4aac-93dd-260dc0a211de None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.563942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75955-1fc4-4aac-93dd-260dc0a211de None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.564215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75955-1fc4-4aac-93dd-260dc0a211de None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.565895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 21/39] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:23.572148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.572445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.572698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.611596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:23.612725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:23.616650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303174-331a-403e-ad69-9466e5b22ce1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:23.661620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e12c2-a4c3-44fa-b851-4e342590fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:23.662267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e12c2-a4c3-44fa-b851-4e342590fa52 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.662542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e12c2-a4c3-44fa-b851-4e342590fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.662808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e12c2-a4c3-44fa-b851-4e342590fa52 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.663543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e12c2-a4c3-44fa-b851-4e342590fa52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:23.665091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e12c2-a4c3-44fa-b851-4e342590fa52 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:23.673458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:23.744970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 22/40] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:23.768869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:23.853029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 19/41] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:02:23 2022] POST /identity/v3/projects => generated 301 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:02:23.881944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d238-402c-463a-8037-9f48f8f2a4ff None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.882565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d238-402c-463a-8037-9f48f8f2a4ff None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.883053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d238-402c-463a-8037-9f48f8f2a4ff None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.885025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 20/42] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:23.890269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.890901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.891418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.897372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c607b-04c0-4037-998b-a64fc42854f4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:23.914280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:23.916597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:23.933433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:23.945292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:23.945974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:23.946427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:23.946710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:23.947594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:23.950056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:23.978322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 23/43] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 05:02:23 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:02:24.009030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 21/44] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:24.034085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:24.151675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5308-5976-49e8-b03d-912567c0e608 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:24.200315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f1d6-e5ab-4a96-9cb6-c930d473be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:24.201065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f1d6-e5ab-4a96-9cb6-c930d473be96 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:24.201413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f1d6-e5ab-4a96-9cb6-c930d473be96 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:24.201753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f1d6-e5ab-4a96-9cb6-c930d473be96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:24.203010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f1d6-e5ab-4a96-9cb6-c930d473be96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:24.204553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f1d6-e5ab-4a96-9cb6-c930d473be96 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:24.206662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:24.212753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:24.307997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1029a-3d88-4732-8e61-cafade234d14 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:24.324432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:24.342063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad90c7-43da-4647-bff2-8d1a7481cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:24.342675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad90c7-43da-4647-bff2-8d1a7481cf82 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:24.342958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad90c7-43da-4647-bff2-8d1a7481cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:24.343263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad90c7-43da-4647-bff2-8d1a7481cf82 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:24.343945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad90c7-43da-4647-bff2-8d1a7481cf82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:24.345524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad90c7-43da-4647-bff2-8d1a7481cf82 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:24.370263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:02:24 2022] POST /identity/v3/projects => generated 312 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:25.523413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890822a-627b-46e2-919e-592a35df491c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:25.523912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890822a-627b-46e2-919e-592a35df491c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:25.523912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890822a-627b-46e2-919e-592a35df491c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:25.525239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:25.530367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:25.530770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:25.531060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:25.550042 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:25.551904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:25.622941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:25.646421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890822a-627b-46e2-919e-592a35df491c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:25.702016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:25.748520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890822a-627b-46e2-919e-592a35df491c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:25.781503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:25.782067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:25.782347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:25.782618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:25.793868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:25.802796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:25.803700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:25.804546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:25.809816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:25.903464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:25.907129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf43b3-1cee-463f-9f88-f05344ea10cd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:25.941434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:25.942052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:25.942332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:25.942605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:25.943346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:25.943649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:25.945028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:25.956678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:25.962226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:26.060197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e3eff-4f34-415c-8c06-da51734e5686 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:26.074132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:26.095212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:26.095854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.096139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.096417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.097621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:26.099070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:26.101002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:25 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:26.106445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:26.208112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6756b-d179-4a36-bd5f-adec72060f21 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:26.240881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c499869-8264-4565-b356-7ad8b3d50751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:26.241525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c499869-8264-4565-b356-7ad8b3d50751 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.241808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c499869-8264-4565-b356-7ad8b3d50751 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.242082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c499869-8264-4565-b356-7ad8b3d50751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.243242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c499869-8264-4565-b356-7ad8b3d50751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:26.244687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c499869-8264-4565-b356-7ad8b3d50751 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:26.246439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:26.252046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:26.351441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561e7fd-3c56-4388-871f-2e4a55af3f20 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:26.382643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13b4f-54ea-4aec-9701-48ffbe33a942 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.383021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13b4f-54ea-4aec-9701-48ffbe33a942 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.383427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13b4f-54ea-4aec-9701-48ffbe33a942 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.384115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:26.384736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.384846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 26/53] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:26.385025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.385306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.386108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.domain.id=default, user.id=2e4c5eb5f64b47918bbb844c3d24e88a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:26.386419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:26.387902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:26.389755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.390046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.390329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.393833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Aug 5 05:02:26 2022] GET /identity/v3/role_assignments?user.id=2e4c5eb5f64b47918bbb844c3d24e88a&scope.domain.id=default&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:26.410951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:26.412229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:26.437757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:26.486296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 27/55] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:26.509118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:26.558701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:26.618835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735180bf-943f-42d9-a8db-fa51cb2bd795 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:26.652459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f411f8-0093-4f44-bda1-74acc7f3b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:26.653090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f411f8-0093-4f44-bda1-74acc7f3b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.653375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f411f8-0093-4f44-bda1-74acc7f3b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.653652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f411f8-0093-4f44-bda1-74acc7f3b6d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.654774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f411f8-0093-4f44-bda1-74acc7f3b6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:26.656265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f411f8-0093-4f44-bda1-74acc7f3b6d1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:26.657851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:26.663839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:26.759242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a802c-1f4e-4635-b38c-61bbe5d0063a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:26.793058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf75b27-9d72-411f-8689-be5fc18e68b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:26.793677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf75b27-9d72-411f-8689-be5fc18e68b4 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:26.793965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf75b27-9d72-411f-8689-be5fc18e68b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:26.794242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf75b27-9d72-411f-8689-be5fc18e68b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:26.794921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf75b27-9d72-411f-8689-be5fc18e68b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:26.796414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf75b27-9d72-411f-8689-be5fc18e68b4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:26.821236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 28/57] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Aug 5 05:02:26 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:28.807542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014851df-1162-4678-9eaf-655c95b915ac None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:28.808062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014851df-1162-4678-9eaf-655c95b915ac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:28.808147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014851df-1162-4678-9eaf-655c95b915ac None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:28.809427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:28.814376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:28.814770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:28.814926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:28.833158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:28.834306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:28.836969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:28.898090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:28.921966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014851df-1162-4678-9eaf-655c95b915ac None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:29.020846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014851df-1162-4678-9eaf-655c95b915ac None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:29.033622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:29.054439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932dee-500e-410a-9326-02ee6f1d79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:29.055059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932dee-500e-410a-9326-02ee6f1d79f9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:29.055374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932dee-500e-410a-9326-02ee6f1d79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:29.055649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932dee-500e-410a-9326-02ee6f1d79f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:29.062294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932dee-500e-410a-9326-02ee6f1d79f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:29.064216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932dee-500e-410a-9326-02ee6f1d79f9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:29.065811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:29.071271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:29.165570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7abadd-5c36-438c-b12f-e4c475c43804 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:29.198570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77034b-6563-45f8-8bf1-98964c9a526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:29.199450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77034b-6563-45f8-8bf1-98964c9a526c None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:29.199732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77034b-6563-45f8-8bf1-98964c9a526c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:29.200006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77034b-6563-45f8-8bf1-98964c9a526c None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:29.200684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77034b-6563-45f8-8bf1-98964c9a526c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:29.202134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77034b-6563-45f8-8bf1-98964c9a526c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:29.217671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:29.228207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:29 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:32.444736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da970-5dd3-41cf-9aa5-f19906d397f0 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.445738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da970-5dd3-41cf-9aa5-f19906d397f0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.446242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da970-5dd3-41cf-9aa5-f19906d397f0 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.447826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:32.453527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.454349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.454853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.484263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:32.485823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:32.505282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc8c84-dec9-4a59-9503-5bf7302640c5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.505893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc8c84-dec9-4a59-9503-5bf7302640c5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.506394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc8c84-dec9-4a59-9503-5bf7302640c5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.508079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 33/63] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:32.528136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c76b-5439-43ae-ad08-09a9aedf9382 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.528734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c76b-5439-43ae-ad08-09a9aedf9382 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.529211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c76b-5439-43ae-ad08-09a9aedf9382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.560486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8d67c76b-5439-43ae-ad08-09a9aedf9382 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:32.562030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8d67c76b-5439-43ae-ad08-09a9aedf9382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:32.575261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 31/64] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:32.603401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:32.671938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:32.678176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126fbe-a009-45f0-960d-bf944b815014 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.678176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126fbe-a009-45f0-960d-bf944b815014 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.678176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126fbe-a009-45f0-960d-bf944b815014 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.678176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 35/66] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:32.685643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.685931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.686210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.719112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:32.720627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:32.728840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76dc1-d125-4a2a-bf42-cef975bcde0b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:32.755666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:32.770374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:32.771388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.771870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.772335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.783462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:32.789250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:32.790178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:32.790931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:32.793253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 32/67] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:32.798797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:32.810603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 36/68] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:32.810603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:32.854848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:32.911242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37feb6-49c4-420e-9c60-2b2365c11ddb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:32.915650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7b45-e18e-43ab-aea3-f3168a224adf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:32.946194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:32.946801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.947089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.947392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.948093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:32.948403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:32.948965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e414-c067-440c-bc7f-c42acc26e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:32.949858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e414-c067-440c-bc7f-c42acc26e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.950023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbfd29-b931-4e12-812a-6c233c075413 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:32.950169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e414-c067-440c-bc7f-c42acc26e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.950424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e414-c067-440c-bc7f-c42acc26e8a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.958409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 37/69] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:32.959738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb37b-f484-4136-a4c7-ac12f7414a1d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.960024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb37b-f484-4136-a4c7-ac12f7414a1d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.960297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb37b-f484-4136-a4c7-ac12f7414a1d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.961391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5e414-c067-440c-bc7f-c42acc26e8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:32.961491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 38/70] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:32.962167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb37b-f484-4136-a4c7-ac12f7414a1d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ead5e414-c067-440c-bc7f-c42acc26e8a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:32.966585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:32.967434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:32.968219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 33/71] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:02:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:32.968941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1939-a786-4e9d-8bf0-abdd5a9feba5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:32.969278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1939-a786-4e9d-8bf0-abdd5a9feba5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:32.969515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1939-a786-4e9d-8bf0-abdd5a9feba5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:32.970753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 34/72] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:32.975634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1939-a786-4e9d-8bf0-abdd5a9feba5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.022210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.072768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb37b-f484-4136-a4c7-ac12f7414a1d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.078187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.085164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1939-a786-4e9d-8bf0-abdd5a9feba5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.110965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41c2f-f509-48a6-8659-831b5f430156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.111635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41c2f-f509-48a6-8659-831b5f430156 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.111921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41c2f-f509-48a6-8659-831b5f430156 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.112198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41c2f-f509-48a6-8659-831b5f430156 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.118419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.119058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.119365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.119640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.123446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b41c2f-f509-48a6-8659-831b5f430156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-27b41c2f-f509-48a6-8659-831b5f430156 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:33.129424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:33.130246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:33.131011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 39/73] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:33.131881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1ac29-cd75-4743-bc82-d3099defae11 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.132080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1ac29-cd75-4743-bc82-d3099defae11 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.132403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1ac29-cd75-4743-bc82-d3099defae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.138344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.139838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.141515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 35/74] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:32 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:33.142270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.149829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6bd1ac29-cd75-4743-bc82-d3099defae11 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:33.151009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6bd1ac29-cd75-4743-bc82-d3099defae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:33.220678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 40/75] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:33.221920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.222358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.222662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.243392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c095b-ff07-46f2-8e84-05dc3ba5eba8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.245762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.246763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:33.248202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:33.278624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.279267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.279549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.279822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.280529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:33.280830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.282240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.289931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 36/76] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:33.292051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.315374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 41/77] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:33.317182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.341818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.396176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2b48a-353e-40a8-a24e-a903fb53cde3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.416072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617e0d5-f5a7-470a-97d9-d2f7ce25733e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.429198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.429817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.430101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.430384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.431090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:33.431427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.432827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.440651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 37/78] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:33.441972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.451201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.451930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.452633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.452920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.471037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.521774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.523290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.540873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc0a-2d17-446e-8df7-644463ac1401 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.547178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.573741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.574639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.574923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.575224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.576364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.577799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.579403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 38/79] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:33.580159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.627598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 42/80] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:33.628822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.673416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.680028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b5543-9780-420b-af95-7b36137b3ed9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.712822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.713452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.713734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.714003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.715135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.716618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.718657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 39/81] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:33.719434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.729271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335494c-81e3-45fd-a9a3-fa113ab098d6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.752558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.764132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.764792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.765069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.765365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.778550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:33.783502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:33.784351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:33.790618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.830537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899534-3ff5-41cb-8d5d-444ac2b9db6e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.870177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.870834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.871119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.871436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.872715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.874192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.875834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 40/83] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:33.880132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:33.898968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85363ed-40fe-4bc2-88bb-7e9fd862c859 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:33.915592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:33.940010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:33.940643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:33.941017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:33.941218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:33.941907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:33.943428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:33.976628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 44/84] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:33 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:33.977455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.008819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f570-249f-4440-a315-82d9ab52391a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.041796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.062187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.062867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.063233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.063547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.064918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.066493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.073391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 41/85] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:34.073391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.122372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5591-d421-4065-8a59-21e09cab80ac None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.172613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.173136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.173471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.173666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.195295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.198212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1277-f78a-4d5e-bc50-92ae2f35c4f9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.246945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.247960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.248255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.248843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.249527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:34.249838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.252503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.260043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.262385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.262753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 42/86] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:34.263626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.313691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.384249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fe22c-c389-4ee8-857b-18ab382baf84 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.387600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 45/87] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:34.388079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.421424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.422495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.422977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.423471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.458162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.497876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b87843-6ee7-4747-a3e3-843ea91693da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.502893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.504943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.536590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.537142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.537429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.537706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.538794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=1a5557b8f0984687a1118a8e8229c0ef) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:34.539110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.541045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.549263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 46/88] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/role_assignments?user.id=1a5557b8f0984687a1118a8e8229c0ef&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:34.550080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.565883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.665523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 43/89] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:34.666752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.727265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844606-e679-457c-bb6c-c962750b8094 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.758964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.777941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.778823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.780231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.780651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.785496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.787261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.791031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:34.796257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.840676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18853c-313f-488d-8c72-713144b61a60 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:34.900420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:34.901317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:34.901744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:34.902162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:34.903619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:34.906628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:34.909181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:34.911232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:34.939515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:34.986370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c281-eb95-4124-855b-430c7748bd44 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:35.047333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:35.048334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:35.050418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:35.050853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:35.053439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:35.055289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:35.059704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 48/92] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:35.061518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:35.085675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384e1af-a30e-4db5-9ecc-5bd954fe4ee9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:35.137653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:35.156731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:35.157625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:35.158735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:35.159197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:35.213661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b0323-81e4-4225-9db9-b030d72a160a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:35.254730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:35.256537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:35.257016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:35.257480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:35.258496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] RBAC: Adding query filter params (role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=1a5557b8f0984687a1118a8e8229c0ef) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:35.258996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:35.260632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:35.267770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 49/93] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:35 2022] GET /identity/v3/role_assignments?user.id=1a5557b8f0984687a1118a8e8229c0ef&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:35.269273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:35.274816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:35.327220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:35.329227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:35.445841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 45/94] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:35.452267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:35.463720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781b84-074f-4a54-8796-11b54fa8b2f8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:35.504187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:35.527990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:35.529349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:35.529825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:35.530291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:35.531338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=2e4c5eb5f64b47918bbb844c3d24e88a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:35.531842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:35.533491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:35.554057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 50/95] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:35 2022] GET /identity/v3/role_assignments?user.id=2e4c5eb5f64b47918bbb844c3d24e88a&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:35.635922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7300-afe2-4b5d-a194-275ad7ec7273 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:35.689139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed553043-5943-434f-9cce-fea9c59db81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:35.689814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed553043-5943-434f-9cce-fea9c59db81e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:35.690103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed553043-5943-434f-9cce-fea9c59db81e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:35.690382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed553043-5943-434f-9cce-fea9c59db81e None admin] PATH_INFO: `/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:35.692242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed553043-5943-434f-9cce-fea9c59db81e None admin] RBAC: Authorizing `identity:get_project(project_id=1204ac6dcdfd4dfa8e14625b8e8a89f6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:35.693725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed553043-5943-434f-9cce-fea9c59db81e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:35.695724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 46/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:35 2022] GET /identity/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6 => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:35.701748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:35.821190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:35.858425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec476-2c78-48b7-99f3-860ae05e57df None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:35.896641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:35.897573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:35.898046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:35.898520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:35.899523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=1204ac6dcdfd4dfa8e14625b8e8a89f6, user.id=1a5557b8f0984687a1118a8e8229c0ef) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:35.900060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:35.901684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717aa46-4b8f-4856-98f4-ff25d942f294 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:35.907771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 51/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:35 2022] GET /identity/v3/role_assignments?user.id=1a5557b8f0984687a1118a8e8229c0ef&scope.project.id=1204ac6dcdfd4dfa8e14625b8e8a89f6&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:36.656455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16720-7210-4386-aafe-53ce8d022b32 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:36.656992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16720-7210-4386-aafe-53ce8d022b32 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:36.656992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16720-7210-4386-aafe-53ce8d022b32 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:36.658645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 47/98] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:36.663963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f0ee-eb09-4ffb-978d-0f53b58a6fb6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:36.664783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f0ee-eb09-4ffb-978d-0f53b58a6fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:36.665306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f0ee-eb09-4ffb-978d-0f53b58a6fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:36.687710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-da02f0ee-eb09-4ffb-978d-0f53b58a6fb6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:36.689234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-da02f0ee-eb09-4ffb-978d-0f53b58a6fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:36.778001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 52/99] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:36.820583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16720-7210-4386-aafe-53ce8d022b32 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:36.927858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:36.932773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16720-7210-4386-aafe-53ce8d022b32 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:36.977237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:36.977902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:36.978243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:36.978525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:36.985616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3462c-1c53-462d-995f-f24a40b2cb68 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:36.985906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3462c-1c53-462d-995f-f24a40b2cb68 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:36.986181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3462c-1c53-462d-995f-f24a40b2cb68 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:36.987816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 53/100] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:36.993057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:36.993347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:36.993631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:36.995504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:37.000816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:37.001701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:37.002472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:37.005264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 48/101] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:37.011144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:37.012724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:37.013979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:37.123520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:37.146716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 54/102] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:37.178576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:37.235636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c35b-d4ae-4716-a4bf-b04cf37b8dc6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:37.322651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:37.323333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.323631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.323909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:37.324907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:37.325220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:37.326731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e72776-c96f-41b7-a90f-704999c353dc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:37.354112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 49/103] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:37.355355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0b1e7-f21b-4c92-931e-bb1d7f3e1a2b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.355652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0b1e7-f21b-4c92-931e-bb1d7f3e1a2b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.355935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0b1e7-f21b-4c92-931e-bb1d7f3e1a2b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:37.357283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 50/104] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:37.363889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.364182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.364462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:37.400996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:37.403142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:37.406864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f739-b739-4eda-beaf-c588b0c4269c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:37.435988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:37.467362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:37.468034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.468319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.468593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:37.471314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:37.474116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:37.475900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 55/105] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:37.479049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:37.533648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 51/106] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:37.535601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:37.590991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:37.664957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbabb7f-124b-496d-bf69-38da57387ac5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:37.708479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a3bf6-fa8b-4a26-ab39-14b7739bfba3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:37.725636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:37.726341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.726630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.726909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] PATH_INFO: `/v3/users/6194e19e7fc349b29c04c7b655d93f46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:37.752965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] RBAC: Authorizing `identity:get_user(user_id=6194e19e7fc349b29c04c7b655d93f46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:37.755044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:37.756974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 56/107] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:37 2022] GET /identity/v3/users/6194e19e7fc349b29c04c7b655d93f46 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:37.757529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:37.802430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:37.803452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.803917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.804371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:37.805227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:37.806932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:37.851861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 52/108] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:02:37 2022] POST /identity/v3/projects => generated 302 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:37.854214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:37.859796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:37.919370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e50c-7bb1-42fa-8b4d-8e8dac3e8dcb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:37.955538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:37.991237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:37.992291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:37.992777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:37.994396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.018081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:38.026769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:38.027753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:38.028554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:38.032095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 57/109] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:38.039197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:38.084163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2da48-94c5-4051-aa13-e0c4191b7dec None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:38.160564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99cbf9-781e-4564-aacf-171bfcfbcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:38.161579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99cbf9-781e-4564-aacf-171bfcfbcb13 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.162063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99cbf9-781e-4564-aacf-171bfcfbcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.162536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99cbf9-781e-4564-aacf-171bfcfbcb13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.194382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccf177-f528-4973-9900-2a589e4e9f27 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:38.249072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:38.250222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.251769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.252248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.253451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:38.254899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:38.256725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:38.275632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 58/110] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:38.281025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99cbf9-781e-4564-aacf-171bfcfbcb13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:38.282168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:38.286243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99cbf9-781e-4564-aacf-171bfcfbcb13 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:38.294884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:38.368237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:38.427678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856b285-f9ea-4b40-8172-f8924010486b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:38.465632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b45f5-415c-47ef-a5d9-9400bc65692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:38.466442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b45f5-415c-47ef-a5d9-9400bc65692d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.466875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b45f5-415c-47ef-a5d9-9400bc65692d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.467317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b45f5-415c-47ef-a5d9-9400bc65692d None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.469170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b45f5-415c-47ef-a5d9-9400bc65692d None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:38.470862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b45f5-415c-47ef-a5d9-9400bc65692d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:38.473183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 59/111] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:38 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:38.474852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21df067-3190-423a-bfee-582d843cbc63 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.475286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21df067-3190-423a-bfee-582d843cbc63 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.475667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21df067-3190-423a-bfee-582d843cbc63 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.477285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 60/112] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:38.478872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21df067-3190-423a-bfee-582d843cbc63 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:38.557637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 53/113] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:38.558927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.559249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.559791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.584144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:38.585344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:38.600263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21df067-3190-423a-bfee-582d843cbc63 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:38.610959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:38.643611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909961-679f-4a9d-b158-60f61cdea88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:38.644860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909961-679f-4a9d-b158-60f61cdea88c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.645150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909961-679f-4a9d-b158-60f61cdea88c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.645429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909961-679f-4a9d-b158-60f61cdea88c None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.647330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42909961-679f-4a9d-b158-60f61cdea88c None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:38.649268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42909961-679f-4a9d-b158-60f61cdea88c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:38.651774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 61/114] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:38 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:38.653268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108457-1069-46d3-b56b-ec67cdfd929d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.653955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108457-1069-46d3-b56b-ec67cdfd929d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.654238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108457-1069-46d3-b56b-ec67cdfd929d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.655658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 62/115] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:38.656208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108457-1069-46d3-b56b-ec67cdfd929d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:38.676548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 54/116] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:38.677552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:38.713425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:38.786188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108457-1069-46d3-b56b-ec67cdfd929d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:38.788918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b8719-01d9-4c73-951c-105cfbcff085 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:38.822268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead9d0a-fc00-4a6e-bd13-d7d27f436a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:38.822676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef37e4-da96-49f6-badc-4038b2f2bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:38.822865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead9d0a-fc00-4a6e-bd13-d7d27f436a9a None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.823138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead9d0a-fc00-4a6e-bd13-d7d27f436a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.823422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef37e4-da96-49f6-badc-4038b2f2bf3e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.823515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead9d0a-fc00-4a6e-bd13-d7d27f436a9a None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/1a5557b8f0984687a1118a8e8229c0ef/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.823711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef37e4-da96-49f6-badc-4038b2f2bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.824052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef37e4-da96-49f6-badc-4038b2f2bf3e None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.825601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef37e4-da96-49f6-badc-4038b2f2bf3e None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:38.825695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead9d0a-fc00-4a6e-bd13-d7d27f436a9a None admin] RBAC: Authorizing `identity:create_grant(project_id=0dc12badcb1f4c97a86d74fe7f35dba0, user_id=1a5557b8f0984687a1118a8e8229c0ef, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:38.827070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead9d0a-fc00-4a6e-bd13-d7d27f436a9a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:38.827272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef37e4-da96-49f6-badc-4038b2f2bf3e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:38.833650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 63/117] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:38 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:38.833650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.833650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.833650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.855204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 55/118] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:38 2022] PUT /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/1a5557b8f0984687a1118a8e8229c0ef/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:38.855204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838ae7-9785-4c00-8269-068c478d91df None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:38.855204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838ae7-9785-4c00-8269-068c478d91df None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:38.855204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838ae7-9785-4c00-8269-068c478d91df None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:38.855204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 56/119] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:38.855204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d838ae7-9785-4c00-8269-068c478d91df None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:38.860847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:38.862126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:38.927408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:38.980311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 64/120] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:38.980311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.006567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:39.022157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d838ae7-9785-4c00-8269-068c478d91df None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.061517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6100ebc-9299-4cdb-9da7-dca3bb96226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.062177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100ebc-9299-4cdb-9da7-dca3bb96226e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.062462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100ebc-9299-4cdb-9da7-dca3bb96226e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.062742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100ebc-9299-4cdb-9da7-dca3bb96226e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.078414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6100ebc-9299-4cdb-9da7-dca3bb96226e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c6100ebc-9299-4cdb-9da7-dca3bb96226e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:39.084613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:39.085506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:39.086264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 57/121] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:39.086994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.087611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.087611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.106757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8cda9-cb09-4015-a3db-6dc79643f458 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.111360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:39.113104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:39.145800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.146557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.146981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.147390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.148326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] RBAC: Adding query filter params (role.id=eef65fdb7e6246b8bd58121c962366e3, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=6194e19e7fc349b29c04c7b655d93f46) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:39.148790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:39.150438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:39.156430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 65/122] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:38 2022] GET /identity/v3/role_assignments?user.id=6194e19e7fc349b29c04c7b655d93f46&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=eef65fdb7e6246b8bd58121c962366e3 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:39.157336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.223841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 58/123] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:39.226746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.247781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:39.367941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f4c3-c715-4d32-b2fa-e6fb29c097bd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.402698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:39.422017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.423307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.423795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.424977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.447267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc09f8e-e959-48a6-965c-d6c0fcb66ba9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.451644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:39.462700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:39.463637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:39.464401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 66/124] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:39.465024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.516601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.517270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.517555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.517823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.518543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:39.518899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:39.520831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:39.542362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 59/125] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:39.543198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.660945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7bc13-bea3-43b6-9a02-f40f44e57d5f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.668271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:39.705771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.706474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.706753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.707023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.718525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:39.725000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:39.725880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:39.726648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 67/126] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:39.731840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.765299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8925e-c522-4d17-953d-9353bebee83e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.838860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.839510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.839787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.840059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.840774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:39.841075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:39.842448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:39.862012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 60/127] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:39.864260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.879209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:39.882159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78689311-f03a-4f3a-afd3-37f5b6ff14ec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:39.929741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:39.930358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:39.930646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:39.930924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:39.932463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:39.933923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:39.935773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 68/128] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:39.937515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:39.983251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:40.042407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c98ae-35d4-4ac7-b2a3-0d87fd5d55e6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.079490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.080113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.080400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.080676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.082037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:40.082360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.084089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.094538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 61/129] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:40.098338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.132241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf90205-a012-4269-8731-e9da56110a8b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.199928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:40.223885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.224546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.224830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.225108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.227748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.229226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.231006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 69/130] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:39 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:40.231623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.238597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535fbb4-2829-4b8a-b23b-27b8cdcc7b86 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.276323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.276973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.277256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.277532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.278766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.280356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.282495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 62/131] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:40 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:40.283260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.388793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:40.394737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385be89-fc79-47e2-8154-d325df8a3780 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.399365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126630ed-7ea2-427c-9a6d-788b7889f3a5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.432163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.432988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.433277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.433598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.434762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.436364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.438005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 63/132] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:40 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:40.438792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.443037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:40.470728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.471763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.472825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.473474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.474854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.476519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.487649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 70/133] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:40 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:40.488849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.550660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d16f0-6a1d-4e02-b4b1-b5aa00c1f788 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.589405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.590112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.590399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.590678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/2e4c5eb5f64b47918bbb844c3d24e88a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.592760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dc12badcb1f4c97a86d74fe7f35dba0, user_id=2e4c5eb5f64b47918bbb844c3d24e88a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.594397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.617968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 64/134] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:40 2022] PUT /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/2e4c5eb5f64b47918bbb844c3d24e88a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:40.619524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.701531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79bbe-98a7-4d95-b4f0-3f907d98769b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.709694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:40.750837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ef2c-04c3-45af-9f16-460149d51d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.751568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ef2c-04c3-45af-9f16-460149d51d05 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.751853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ef2c-04c3-45af-9f16-460149d51d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.752129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ef2c-04c3-45af-9f16-460149d51d05 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/1a5557b8f0984687a1118a8e8229c0ef/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.754559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8237-009c-4490-afbd-5f4cc23f6dd4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:40.757298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ef2c-04c3-45af-9f16-460149d51d05 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dc12badcb1f4c97a86d74fe7f35dba0, user_id=1a5557b8f0984687a1118a8e8229c0ef, role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.758777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ef2c-04c3-45af-9f16-460149d51d05 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.786424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 71/135] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:40 2022] PUT /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/1a5557b8f0984687a1118a8e8229c0ef/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:40.787772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5facb-cddd-4fe4-9d48-a836654214bd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.788056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5facb-cddd-4fe4-9d48-a836654214bd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.788326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5facb-cddd-4fe4-9d48-a836654214bd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.789723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 72/136] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:40.796382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.796755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.796972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.797836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:40.798633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:40.798924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:40.799230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] PATH_INFO: `/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:40.800590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] RBAC: Authorizing `identity:get_project(project_id=1204ac6dcdfd4dfa8e14625b8e8a89f6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:40.802228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:40.804083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 65/137] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:40 2022] GET /identity/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:40.813509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:40.839371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:40.840988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:40.868077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:40.951959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 73/138] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:40.957293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95986deb-fb52-48d7-971a-a07e53065050 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:41.004298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:41.007540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:41.022013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:41.022709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:41.022995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:41.023408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] PATH_INFO: `/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6/users/1a5557b8f0984687a1118a8e8229c0ef/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:41.026308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] RBAC: Authorizing `identity:create_grant(project_id=1204ac6dcdfd4dfa8e14625b8e8a89f6, user_id=1a5557b8f0984687a1118a8e8229c0ef, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:41.030307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:41.054021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 66/139] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:40 2022] PUT /identity/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6/users/1a5557b8f0984687a1118a8e8229c0ef/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:02:41.144251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf2de8-bcae-413f-a68e-6577830a83c0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:41.184505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b670f-ec76-46d9-9e57-f3ba6889984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:41.185158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b670f-ec76-46d9-9e57-f3ba6889984c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:41.185456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b670f-ec76-46d9-9e57-f3ba6889984c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:41.185763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b670f-ec76-46d9-9e57-f3ba6889984c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:41.186916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b670f-ec76-46d9-9e57-f3ba6889984c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:41.188456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b670f-ec76-46d9-9e57-f3ba6889984c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:41.190156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 74/140] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:41.200566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:41.328025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47212e-5a6d-45d7-8a6f-6da2b232c01f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:41.379927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79543c4-db89-47ea-a66b-c64ec6e5ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:41.380950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79543c4-db89-47ea-a66b-c64ec6e5ab7b None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:41.381436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79543c4-db89-47ea-a66b-c64ec6e5ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:41.381908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79543c4-db89-47ea-a66b-c64ec6e5ab7b None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:41.382835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79543c4-db89-47ea-a66b-c64ec6e5ab7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:41.384575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79543c4-db89-47ea-a66b-c64ec6e5ab7b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:41.418907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 67/141] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:41 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:41.515099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb29a6-e1a5-4a86-a91b-b467cec10d91 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:41.515436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb29a6-e1a5-4a86-a91b-b467cec10d91 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:41.515696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb29a6-e1a5-4a86-a91b-b467cec10d91 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:41.517550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 75/142] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:41.523937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:41.524547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:41.525021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:41.552374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:41.553963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:41.608653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:41.638938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 68/143] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:41.673841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb29a6-e1a5-4a86-a91b-b467cec10d91 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:41.707662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:41.816350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb29a6-e1a5-4a86-a91b-b467cec10d91 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:41.857017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a29944-8059-4449-bc3a-bd926a98d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:41.857654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29944-8059-4449-bc3a-bd926a98d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:41.857992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29944-8059-4449-bc3a-bd926a98d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:41.858272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29944-8059-4449-bc3a-bd926a98d6f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:41.873981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a29944-8059-4449-bc3a-bd926a98d6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-07a29944-8059-4449-bc3a-bd926a98d6f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:41.879490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:41.880349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:41.881123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 76/144] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:41.887184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.027610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d1799-b296-45b9-9928-a5717d5f7f14 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:42.072253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:42.073236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.073719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.074440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.075562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:42.076094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:42.077756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:42.084914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3208-16f4-40a9-9dee-a34b208a7e16 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.085392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3208-16f4-40a9-9dee-a34b208a7e16 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.085490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3208-16f4-40a9-9dee-a34b208a7e16 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.086816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 77/145] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:42.088633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 69/146] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:42.094833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.094833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.094833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.096266 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.122207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:42.123516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:42.167669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:42.269341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 78/147] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:42.281308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b112-0086-4727-abd7-3b02fad5af48 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:42.298077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.325483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:42.332904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:42.333561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.333904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.334184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.335407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:42.336933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:42.338845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 70/148] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:42 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:42.344022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.466513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5699071-528a-4aee-8b14-f7ff44831cb5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:42.478109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:42.509112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:42.509739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.510017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.510291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.569191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b72eda-3933-4251-9c70-f4175ba23dbc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:42.592579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:42.594135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:42.688451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:42.689112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.689452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.689733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.715061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 71/149] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:42.723127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:42.724030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:42.728148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:42.728998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:42.729769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:42.735638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 79/150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:42.739500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:42.752481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.860180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f4fc-82f3-4d55-9abc-6e0f36fade62 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:42.895103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:42.904809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:42.905457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.905742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.906381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.907916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:42.910995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:42.914939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 72/151] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:42 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:42.921506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:42.937875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64940a-c10a-4107-9942-8e97bd0a1951 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:42.988154 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:42.988976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:42.989397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:42.989926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:42.991765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:42.992184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:42.993598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:43.005916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 80/152] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:43.011480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:43.063531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:43.102994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c13e8-fd5c-429d-9b63-2738f84426ea None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:43.180132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:43.181138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:43.181659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:43.182109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:43.187621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=1a5557b8f0984687a1118a8e8229c0ef) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:43.188198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:43.190996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:43.220724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 73/153] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:42 2022] GET /identity/v3/role_assignments?user.id=1a5557b8f0984687a1118a8e8229c0ef&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:43.244902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4d0a5-7877-4599-83b7-fb5ce32657b2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:43.314278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:43.323662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:43.324994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:43.325549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:43.326040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] PATH_INFO: `/v3/users/6194e19e7fc349b29c04c7b655d93f46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:43.328245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] RBAC: Authorizing `identity:get_user(user_id=6194e19e7fc349b29c04c7b655d93f46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:43.330901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:43.333898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 81/154] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:43 2022] GET /identity/v3/users/6194e19e7fc349b29c04c7b655d93f46 => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:43.341978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:43.527403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78887e1-12a7-461a-9060-669270ddea49 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:43.593950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad72352-0b90-494e-8286-7370de9a9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:43.594988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad72352-0b90-494e-8286-7370de9a9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:43.595487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad72352-0b90-494e-8286-7370de9a9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:43.595960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad72352-0b90-494e-8286-7370de9a9a07 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:43.598398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad72352-0b90-494e-8286-7370de9a9a07 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:43.601100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad72352-0b90-494e-8286-7370de9a9a07 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:43.604239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 74/155] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:43 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:43.613819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:43.789063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a85f4-d87f-4ff9-9bdd-1699f7beaa7a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:43.833970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197bab0-c27e-49b8-aca9-3217732a03a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:43.835013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197bab0-c27e-49b8-aca9-3217732a03a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:43.835526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197bab0-c27e-49b8-aca9-3217732a03a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:43.835999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197bab0-c27e-49b8-aca9-3217732a03a9 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/6194e19e7fc349b29c04c7b655d93f46/roles/eef65fdb7e6246b8bd58121c962366e3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:43.844454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197bab0-c27e-49b8-aca9-3217732a03a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dc12badcb1f4c97a86d74fe7f35dba0, user_id=6194e19e7fc349b29c04c7b655d93f46, role_id=eef65fdb7e6246b8bd58121c962366e3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:43.846128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197bab0-c27e-49b8-aca9-3217732a03a9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:43.874978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 82/156] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:43 2022] PUT /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/users/6194e19e7fc349b29c04c7b655d93f46/roles/eef65fdb7e6246b8bd58121c962366e3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:43.996338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703b0d8-f357-4047-be8d-a3541285233b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:43.997908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703b0d8-f357-4047-be8d-a3541285233b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:43.998693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703b0d8-f357-4047-be8d-a3541285233b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.001490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 75/157] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:44.007142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.007511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.007749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.035787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:44.036983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:44.113819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:44.129528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 83/158] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:44.166356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa276e-d1f4-4c9b-9364-f6e07ed82295 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.166792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa276e-d1f4-4c9b-9364-f6e07ed82295 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.167299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa276e-d1f4-4c9b-9364-f6e07ed82295 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.170058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 76/159] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:44.174530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:44.177083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.177546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.178002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.240293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:44.242328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:44.245986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:44.337621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b4035-e0ce-4da7-bcb2-f67779d86b44 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:44.399927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:44.400578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.400852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.401118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.421767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 77/160] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:44.422114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:44.427079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:44.429485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:44.431622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 84/161] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:44.439450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:44.468597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:44.551227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de152730-6bcd-45a4-a9d9-6a23c683ebea None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:44.573274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:44.586663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:44.587336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.587618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.587886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.588612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:44.588912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:44.590288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:44.600787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:44.601103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 78/162] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:44.612366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:44.646744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4154-f2dc-497f-8a7e-425c05af695e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:44.717483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:44.718044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.718326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.718592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.734471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:44.744007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:44.744949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:44.745749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 85/163] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:44.756129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:44.759003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ebdc9-3db9-4ec5-96dd-e55a83c46519 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:44.819064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:44.819741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.820020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.820289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] PATH_INFO: `/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.822578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=2e4c5eb5f64b47918bbb844c3d24e88a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:44.824355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:44.825973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 79/164] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:44 2022] GET /identity/v3/users/2e4c5eb5f64b47918bbb844c3d24e88a => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:44.831760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:44.913638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30b31-3ca1-445e-a3b9-5341b5ec0840 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:44.923536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:44.933344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:44.979371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd498f1-e139-464a-a7cc-3481c9939dc6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:44.979843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:44.980478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:44.980757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:44.981027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:44.981751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:44.982050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:44.983443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:44.992652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 86/165] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:02:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:45.005855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:45.037581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5d61-245b-4155-a1bb-957323b75b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:45.038243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5d61-245b-4155-a1bb-957323b75b47 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.038494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5d61-245b-4155-a1bb-957323b75b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.038769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5d61-245b-4155-a1bb-957323b75b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.145143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5d61-245b-4155-a1bb-957323b75b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:45.146638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5d61-245b-4155-a1bb-957323b75b47 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:45.195469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec346-ab35-4753-8dd6-f4a5dadfb52a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:45.263953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:45.264527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.264807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.265081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.266305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:45.267772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:45.270254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 87/166] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:45 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:45.275778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:45.283504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:45.338689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:45.364788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 80/167] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 05:02:45.366150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea03ba-945e-4794-8e76-f699dd8f8dff None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.366443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea03ba-945e-4794-8e76-f699dd8f8dff None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.366720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea03ba-945e-4794-8e76-f699dd8f8dff None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.371070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 81/168] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:45.379347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea03ba-945e-4794-8e76-f699dd8f8dff None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:45.427901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f2f-d8e8-44b1-9d26-35ce204d35b1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:45.505386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:45.506228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.506338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.506627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.530644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea03ba-945e-4794-8e76-f699dd8f8dff None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:45.601690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2536e2-4045-425c-a70e-a9f15bbfbe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:45.602343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2536e2-4045-425c-a70e-a9f15bbfbe15 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.602619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2536e2-4045-425c-a70e-a9f15bbfbe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.602889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2536e2-4045-425c-a70e-a9f15bbfbe15 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.604166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2536e2-4045-425c-a70e-a9f15bbfbe15 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:45.605609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2536e2-4045-425c-a70e-a9f15bbfbe15 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:45.610972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 82/169] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:45 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:45.610972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.610972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.610972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.640265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:45.642388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:45.648208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:45.648208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:45.709496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:45.715499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:45.773907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 88/170] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 05:02:45.774773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:45.789638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 83/171] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:45.790576 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:45.901618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202f547-60d1-4dc8-8681-582567311a5e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:45.966699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:45.967374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:45.967659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:45.967938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:45.968735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=2e4c5eb5f64b47918bbb844c3d24e88a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:45.969045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:45.970590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:45.994121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 89/172] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:45 2022] GET /identity/v3/role_assignments?user.id=2e4c5eb5f64b47918bbb844c3d24e88a&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:45.994976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:45.999500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:46.016271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6feae1-77c9-4c9e-a330-e68a94e8ab2e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:46.082429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:46.083219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.083565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.083891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.085094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:46.086547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:46.089579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 84/173] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:45 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:46.094730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:46.147611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:46.167029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898f30-cb8b-4284-b3ee-c60ad3a18211 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:46.205552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42beaa-04f1-420e-a8ea-5d451bc587ee None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:46.260492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:46.261133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.261420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.261691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.262493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] RBAC: Adding query filter params (role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=1a5557b8f0984687a1118a8e8229c0ef) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:46.262799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:46.264308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:46.275728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 85/174] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:46 2022] GET /identity/v3/role_assignments?user.id=1a5557b8f0984687a1118a8e8229c0ef&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:46.288789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:46.289482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.289767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.290047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.302850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:46.320991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:46.321971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:46.322768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 90/175] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:46.328612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:46.480899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:46.488041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec976f79-7f2f-47db-8b0b-f646a5b80ebc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:46.525360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:46.526043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.526338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.526656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.527428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:46.527731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:46.529175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2f2f-2b0e-4106-bc75-a42dc41b35d3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:46.539670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 86/176] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:46.548286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:46.591606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569df8fc-2cfa-44b7-a5c7-06a3609715e1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.591924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569df8fc-2cfa-44b7-a5c7-06a3609715e1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.592171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569df8fc-2cfa-44b7-a5c7-06a3609715e1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.593528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 87/177] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:46.599772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9647ad0-1529-4f01-8c26-651d354cdcab None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.600049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9647ad0-1529-4f01-8c26-651d354cdcab None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.600317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9647ad0-1529-4f01-8c26-651d354cdcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.630086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b9647ad0-1529-4f01-8c26-651d354cdcab None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:46.631342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b9647ad0-1529-4f01-8c26-651d354cdcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:46.649896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:46.696428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7d56-5db2-484c-a681-5646327f7020 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:46.749305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:46.749887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.750171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.750443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] PATH_INFO: `/v3/users/1a5557b8f0984687a1118a8e8229c0ef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.751638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 88/178] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:46.752055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5557b8f0984687a1118a8e8229c0ef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:46.753189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0d30c-1cb8-44b2-94fb-609b63bdb38d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.753574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0d30c-1cb8-44b2-94fb-609b63bdb38d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.753878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:46.753990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0d30c-1cb8-44b2-94fb-609b63bdb38d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.755460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 89/179] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:46.759288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 91/180] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:46 2022] GET /identity/v3/users/1a5557b8f0984687a1118a8e8229c0ef => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:46.761196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.761580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.761825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:46.762214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.789057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:46.790441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:46.878690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:46.887185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:46.901360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0cc2-9b1e-42c6-a0f5-c31b87f7ae62 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:46.905049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:46.938402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:46.944089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:46.944713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:46.944992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:46.945260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:46.993065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66dd10-37fc-48bf-9b9c-6a8b07f44978 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.015576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.016983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.028746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122c3c9-5111-4cc7-8b94-832a0874a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.029627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122c3c9-5111-4cc7-8b94-832a0874a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.030094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122c3c9-5111-4cc7-8b94-832a0874a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.030651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122c3c9-5111-4cc7-8b94-832a0874a4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.042039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122c3c9-5111-4cc7-8b94-832a0874a4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1122c3c9-5111-4cc7-8b94-832a0874a4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:47.047536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:47.048395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:47.049163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:47.051447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 91/182] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:47.057135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62cbd2-5f25-4abd-9995-3fda83e31801 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.057476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62cbd2-5f25-4abd-9995-3fda83e31801 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.057749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62cbd2-5f25-4abd-9995-3fda83e31801 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.059098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 92/183] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:47.059858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62cbd2-5f25-4abd-9995-3fda83e31801 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.129897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 92/184] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 05:02:47.130653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.152079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.170892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.182693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62cbd2-5f25-4abd-9995-3fda83e31801 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.220762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31508c9e-4dca-46b4-ac10-d8fcf76d87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.222383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508c9e-4dca-46b4-ac10-d8fcf76d87cb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.222844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508c9e-4dca-46b4-ac10-d8fcf76d87cb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.223327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508c9e-4dca-46b4-ac10-d8fcf76d87cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.224969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31508c9e-4dca-46b4-ac10-d8fcf76d87cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.226663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31508c9e-4dca-46b4-ac10-d8fcf76d87cb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.228781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 93/185] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:47.230073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.230544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.230817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.246304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6f63-fb4e-4cc8-8e51-7e0ccad71b8e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.250701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:47.251918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:47.286060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.286602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.286884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.287176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.287889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:47.288199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.289578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.299199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 93/186] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:47.299199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.336083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 94/187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:47.337249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.400083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.407053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f151e-7644-43f3-84ba-210f574c6eb7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.426124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.442845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.443549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.443812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.444079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] PATH_INFO: `/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.445207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] RBAC: Authorizing `identity:get_project(project_id=1204ac6dcdfd4dfa8e14625b8e8a89f6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.446633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.448618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 94/188] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/projects/1204ac6dcdfd4dfa8e14625b8e8a89f6 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:47.448974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6c8a-5259-4b74-9765-cfcaecfac1ee None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.449632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.484112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.484715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.484991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.485260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.485929 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.487607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.508573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 95/189] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:47 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:47.512133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.557741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b4aa-1496-4cc5-807b-ec99260b0d27 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.599447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9d272-d7cf-4ff4-8e22-f927eaa754ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.600119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9d272-d7cf-4ff4-8e22-f927eaa754ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.600380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9d272-d7cf-4ff4-8e22-f927eaa754ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.600657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9d272-d7cf-4ff4-8e22-f927eaa754ec None admin] PATH_INFO: `/v3/users/70b90a1cd94b49f5a3955e21998e4922` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.617264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9d272-d7cf-4ff4-8e22-f927eaa754ec None admin] RBAC: Authorizing `identity:get_user(user_id=70b90a1cd94b49f5a3955e21998e4922)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.618758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9d272-d7cf-4ff4-8e22-f927eaa754ec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.620899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 95/190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/users/70b90a1cd94b49f5a3955e21998e4922 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:47.622338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685d81b-77a7-41b0-a758-41a3fec7c020 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.622624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685d81b-77a7-41b0-a758-41a3fec7c020 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.622897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685d81b-77a7-41b0-a758-41a3fec7c020 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.627358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 96/191] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:47.627358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685d81b-77a7-41b0-a758-41a3fec7c020 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.635625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14fc16-5a19-4627-9758-ea50fb97dea1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.653843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.673077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.673736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.674017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.674290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.676312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.688728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:47.694780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:47.695714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:47.696492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 96/192] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:47.697139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.756339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685d81b-77a7-41b0-a758-41a3fec7c020 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.801815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.802453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.802737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.803009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.803830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=1204ac6dcdfd4dfa8e14625b8e8a89f6, user.id=1a5557b8f0984687a1118a8e8229c0ef) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:47.804145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.805591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37869403-bf3a-4967-8279-682b7350ab94 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:47.813591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 97/193] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/role_assignments?user.id=1a5557b8f0984687a1118a8e8229c0ef&scope.project.id=1204ac6dcdfd4dfa8e14625b8e8a89f6&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:47.815052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.816430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.816881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.823932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5512c-be73-46cb-9ea4-17ac62f64de5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:47.836860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:47.838348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:47.870148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:47.870970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:47.871379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:47.871747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:47.937960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 98/194] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:47.939019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:47.947718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.956404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:47.957497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:47.959766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.088927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0239cf-ca67-4f95-bab6-6a08dbae662c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.121243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 97/195] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:48.122540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.130552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.131383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.131552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.131831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.132549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:48.132855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.134227 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.151207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 99/196] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:02:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:48.151207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.252780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:48.262840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:48.272020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fa7a-f61c-43f7-ac64-1e17ef696488 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.289355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3638fd-6aae-4377-bdbd-270a2c8d7868 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.327757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.328436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.329115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.329398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.341145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.342047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.342526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.342915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:48.343240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.344629 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.346310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:48.348071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:48.348994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:48.349791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 98/197] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:48.350459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.351978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 100/198] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:48.357715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.473902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c72e5-034e-4932-86ab-340afc96e88b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.478667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6a1a7-862e-4564-a4a7-54aa10372169 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.514955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.516014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.516496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.517144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] PATH_INFO: `/v3/users/70b90a1cd94b49f5a3955e21998e4922` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.518195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.518891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] RBAC: Authorizing `identity:get_user(user_id=70b90a1cd94b49f5a3955e21998e4922)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.519000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.519314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.519586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.520297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:48.520599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.521538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.521949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.523647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 99/199] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/users/70b90a1cd94b49f5a3955e21998e4922 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:48.524682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.537198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 101/200] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:48.538434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.549558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:48.561144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:48.654460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff8204-31ab-4505-aef6-7f79a36d372b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.662703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0fd1-52ca-401a-a4a9-7188ce8ef972 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.697068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.697777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.698068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.698335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.701978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.702806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.703336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.703802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.704792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=70b90a1cd94b49f5a3955e21998e4922) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:48.705294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.707506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.713313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 100/201] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/role_assignments?user.id=70b90a1cd94b49f5a3955e21998e4922&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:48.714337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.785709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.787732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.798244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:48.829575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:48.866604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54ae52-f996-4459-aab6-23d5cd2cf6be None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:48.942485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:48.944740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:48.946199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:48.946862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] PATH_INFO: `/v3/users/6194e19e7fc349b29c04c7b655d93f46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:48.950274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] RBAC: Authorizing `identity:get_user(user_id=6194e19e7fc349b29c04c7b655d93f46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:48.952321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:48.954723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 101/202] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/users/6194e19e7fc349b29c04c7b655d93f46 => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:48.962267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:48.972803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 102/203] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:48.979026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:49.079822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387e66-d7f2-4cac-a3e6-9b32424b750e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:49.102927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4d61b-9bf3-4bbf-b4b2-805136a2cc57 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:49.113330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:49.127905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:49.129148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:49.129430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:49.129703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:49.161624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:49.181937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:49.182594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:49.182873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:49.183145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:49.188636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:49.192600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:49.195971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 103/204] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:49.200761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:49.264319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:49.266700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:49.394067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa203bb-b269-4e22-86a9-59296999c4be None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:49.402739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 102/205] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 05:02:49.411312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:49.465986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:49.466528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:49.466804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:49.467075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:49.467889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] RBAC: Adding query filter params (role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=70b90a1cd94b49f5a3955e21998e4922) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:49.468196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:49.469632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:49.491265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 104/206] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:49 2022] GET /identity/v3/role_assignments?user.id=70b90a1cd94b49f5a3955e21998e4922&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:49.510055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:49.562112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12c83-1a61-40ca-a9c1-7e4073f46f91 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:49.604617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fde71-008f-4b52-9534-2f19d263ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:49.605285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fde71-008f-4b52-9534-2f19d263ddbf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:49.605564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fde71-008f-4b52-9534-2f19d263ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:49.605838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fde71-008f-4b52-9534-2f19d263ddbf None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:49.607055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fde71-008f-4b52-9534-2f19d263ddbf None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:49.608619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fde71-008f-4b52-9534-2f19d263ddbf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:49.610402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 103/207] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:49 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:49.617991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:49.667490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:49.736114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1613b8-9bed-4a2d-8829-1887a5fa4d50 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:49.774083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:49.774699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:49.775027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:49.775335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:49.776306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] RBAC: Adding query filter params (role.id=eef65fdb7e6246b8bd58121c962366e3, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0, user.id=6194e19e7fc349b29c04c7b655d93f46) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:49.776615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:49.778034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40e726-35bb-4f82-94ef-7e03c196357c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:49.785322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 105/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:49 2022] GET /identity/v3/role_assignments?user.id=6194e19e7fc349b29c04c7b655d93f46&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=eef65fdb7e6246b8bd58121c962366e3 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:50.060606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbba2-57b8-4c66-a6d2-c0402ad9a8da None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.060933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbba2-57b8-4c66-a6d2-c0402ad9a8da None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.061351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbba2-57b8-4c66-a6d2-c0402ad9a8da None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.062859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 104/209] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:50.069054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.069347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.069625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.089462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:50.090649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:50.157762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848f5f-ec76-40ef-8fb8-5dffb8acf40b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.158087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848f5f-ec76-40ef-8fb8-5dffb8acf40b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.158317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848f5f-ec76-40ef-8fb8-5dffb8acf40b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.161006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 105/210] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:50.171632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.171917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.172194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.172605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 106/211] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:50.196214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:50.197402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:50.202152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:50.243392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:50.290722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 106/212] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:50.313623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:50.330639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f86b45-7a4d-473f-b33d-1b3f69c0ee8d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:50.367451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:50.368088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.368367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.368636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.368963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:50.369768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:50.371914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:50.373644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 107/213] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:50.379094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:50.421864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56fba0-7e6c-4250-8058-8eaa5cf57123 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:50.459560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:50.460209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.460492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.460768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.472529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:50.477701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:50.478588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:50.479808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:50.483259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 107/214] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:50.484835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:50.487450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:50.491292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f0dde-700f-4671-8453-392b47b55531 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:50.528622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:50.529234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.529512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.529777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.530450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:50.531968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:50.563743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 108/215] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:50 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:02:50.597996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e93ef9-90f1-447e-961d-2ada7a9f9a9b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:50.613676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:50.637850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:50.638486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.638770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.639046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.639815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:50.640122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:50.641533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:50.651247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 108/216] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:50.657038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:50.781040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762748-4fc9-4d40-9728-d96d7aec2a49 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:50.817987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1593f1-e329-4ce7-84a8-e5f326d17657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:50.818548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1593f1-e329-4ce7-84a8-e5f326d17657 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:50.818815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1593f1-e329-4ce7-84a8-e5f326d17657 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:50.819084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1593f1-e329-4ce7-84a8-e5f326d17657 None admin] PATH_INFO: `/v3/users/624d73234b894c788f660e138e193d8d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:50.834166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1593f1-e329-4ce7-84a8-e5f326d17657 None admin] RBAC: Authorizing `identity:get_user(user_id=624d73234b894c788f660e138e193d8d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:50.835727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1593f1-e329-4ce7-84a8-e5f326d17657 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:50.837584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 109/217] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:50 2022] GET /identity/v3/users/624d73234b894c788f660e138e193d8d => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:50.842864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:50.960010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13ad0b-734c-4e15-99d3-8bcfff70d5f1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:50.999548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:51.000174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.000451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.000720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.016536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266296-4560-4885-aa39-d7520cf04ad1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.017188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266296-4560-4885-aa39-d7520cf04ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.017803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266296-4560-4885-aa39-d7520cf04ad1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.020914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 110/218] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:51.026241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.026770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.027346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.057248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:51.058761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:51.059463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:51.086816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:51.095927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:51.098699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:51.133819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 111/219] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:51.184006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:51.251735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 109/220] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:51.260436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:51.361873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:51.385011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630950-1dea-43f0-8d4f-949f0488fcc5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:51.389797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0d8f-053a-4494-81a0-80d05dd6edf2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:51.427134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:51.427808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.428090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.428369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.429730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:51.431233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:51.433351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 110/221] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:51 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:51.438987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:51.451339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:51.451989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.452271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.452545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.479066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:51.484115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:51.484978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:51.486187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 112/222] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:51.493039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:51.499316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:51.548808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f09b-11de-42f6-85dd-9c81cc578370 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:51.586352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:51.587212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.587625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.587890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.588782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=624d73234b894c788f660e138e193d8d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:51.589094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:51.590539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:51.596977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 111/223] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:51 2022] GET /identity/v3/role_assignments?user.id=624d73234b894c788f660e138e193d8d&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:51.698405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440be3-dee1-42e1-86d1-c02ab3f418da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:51.743215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:51.743865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.744147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.744417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.745144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:51.745446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:51.746841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:51.760924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 113/224] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:51.766727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:51.783467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:51.911869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df9f0-7302-4eef-8e4b-62138b451b20 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:51.961798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611605de-b672-4e2d-b25e-21d1d3893e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:51.962374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611605de-b672-4e2d-b25e-21d1d3893e07 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:51.962655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611605de-b672-4e2d-b25e-21d1d3893e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:51.962931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611605de-b672-4e2d-b25e-21d1d3893e07 None admin] PATH_INFO: `/v3/users/70b90a1cd94b49f5a3955e21998e4922` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:51.967869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611605de-b672-4e2d-b25e-21d1d3893e07 None admin] RBAC: Authorizing `identity:get_user(user_id=70b90a1cd94b49f5a3955e21998e4922)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:51.969337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611605de-b672-4e2d-b25e-21d1d3893e07 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:51.970966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 112/225] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:51 2022] GET /identity/v3/users/70b90a1cd94b49f5a3955e21998e4922 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:51.977528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:52.016342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47936265-f000-4c4e-9b1d-43faf9f3c212 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.016682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47936265-f000-4c4e-9b1d-43faf9f3c212 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.016905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47936265-f000-4c4e-9b1d-43faf9f3c212 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.018945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 113/226] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:52.024054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.024339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.024614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.043293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:52.044498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:52.095541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:52.167391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bee50a-0661-458f-a955-215bd13119a6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:52.172107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 114/227] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:52.224603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:52.227871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:52.228598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.228887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.229165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.230378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:52.231686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:52.232951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:52.234885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 114/228] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:51 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:52.241083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:52.354688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb3b64-6e4f-41dc-a5d4-7bfda023e2c0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:52.399651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bac66-812e-4463-aca1-01cbf61f4bf6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:52.416953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:52.417599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.417877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.418146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.428340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:52.433157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:52.434037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:52.435224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 115/229] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:02:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:52.439935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:52.471979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:52.473180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.473706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.474189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/70b90a1cd94b49f5a3955e21998e4922/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.480635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46, user_id=70b90a1cd94b49f5a3955e21998e4922, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:52.482431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:52.491496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:52.507241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:52.520568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 115/230] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:52 2022] PUT /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/70b90a1cd94b49f5a3955e21998e4922/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:52.551509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202b71c-7ccd-40de-8a81-38a3c73f848e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:52.597901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:52.598529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.598802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.599063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.599827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:52.600127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:52.601518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:52.610628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 116/231] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:02:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:52.616527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:52.788107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed899e0-373a-40dd-b57f-af3305c81df6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:52.826643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:52.827313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:52.827596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:52.827871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] PATH_INFO: `/v3/users/70b90a1cd94b49f5a3955e21998e4922` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:52.829035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] RBAC: Authorizing `identity:get_user(user_id=70b90a1cd94b49f5a3955e21998e4922)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:52.830465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:52.832972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 116/232] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:52 2022] GET /identity/v3/users/70b90a1cd94b49f5a3955e21998e4922 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:52.838273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:52.979479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6c54-a79b-4f25-8dae-70b92c2755cc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:53.011537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:53.019506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1f10a-7f53-4374-93b1-e7062a8de6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:53.020189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1f10a-7f53-4374-93b1-e7062a8de6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.020480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1f10a-7f53-4374-93b1-e7062a8de6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.020763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1f10a-7f53-4374-93b1-e7062a8de6c5 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.027918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1f10a-7f53-4374-93b1-e7062a8de6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:53.029484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1f10a-7f53-4374-93b1-e7062a8de6c5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:53.031544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 117/233] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:52 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:53.038344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:53.137486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:53.187667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664350e0-572b-4161-a91c-3f06f5938b41 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:53.202029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eabaa-2a5f-4a03-9f17-8e8bc5337814 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.202330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eabaa-2a5f-4a03-9f17-8e8bc5337814 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.202586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eabaa-2a5f-4a03-9f17-8e8bc5337814 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.204138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 118/234] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:53.209173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.209748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.210218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.227870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3148d-231f-402f-ada3-76bdeb8a3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:53.228559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3148d-231f-402f-ada3-76bdeb8a3f11 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.228846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3148d-231f-402f-ada3-76bdeb8a3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.229125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3148d-231f-402f-ada3-76bdeb8a3f11 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/70b90a1cd94b49f5a3955e21998e4922/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.232330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3148d-231f-402f-ada3-76bdeb8a3f11 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46, user_id=70b90a1cd94b49f5a3955e21998e4922, role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:53.233937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3148d-231f-402f-ada3-76bdeb8a3f11 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:53.249919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:53.252309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:53.259456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 117/235] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:53 2022] PUT /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/70b90a1cd94b49f5a3955e21998e4922/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:02:53.383996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 119/236] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:53.417280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9d66-318a-4167-9c62-8952cd41cadd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.417835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9d66-318a-4167-9c62-8952cd41cadd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.418259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9d66-318a-4167-9c62-8952cd41cadd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.419708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:53.420687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 118/237] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:53.426205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.426800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.427327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.449944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:53.451812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:53.549149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 119/238] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:53.578829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:53.579355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1998-c4f6-430a-871d-2a10a0b57f8a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:53.610225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:53.625122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:53.625769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.626044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.626369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.639648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:53.651888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:53.663233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:53.664373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:53.665252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 120/239] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:53.670244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:53.697455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9bda-c918-4ced-a1c3-4d8618413575 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:53.742743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:53.743687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.744214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.746634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.748060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:53.750018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:53.761155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 120/240] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:53.764086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:53.889296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c36d-0dbf-43d7-85b6-3e9cd89da9d1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:53.919809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd4728-4850-45e1-977c-7593d977319c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:53.947683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:53.963766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:53.964699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.965156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.965602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.966466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:53.968150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:53.988909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:53.989738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:53.990028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:53.990408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:53.991200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:53.991608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:53.993150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec3186-ed89-4003-8d79-98cd600c4fc0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:53.994663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 121/241] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:53 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:54.012975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 121/242] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:54.019600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.173251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805616f-ea23-434e-aa4a-724856b6074e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:54.190966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21257-1f55-4779-9e91-5551953a53d5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.191357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21257-1f55-4779-9e91-5551953a53d5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.191822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21257-1f55-4779-9e91-5551953a53d5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.193536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 122/243] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:54.204732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.205039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.205299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.216013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:54.216672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.216952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.217223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] PATH_INFO: `/v3/users/523e5814ee964b86a6e6072f2f5c9405` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.233508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] RBAC: Authorizing `identity:get_user(user_id=523e5814ee964b86a6e6072f2f5c9405)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:54.235007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:54.238295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 122/244] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/users/523e5814ee964b86a6e6072f2f5c9405 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:54.244085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.252225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:54.254014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:54.291431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:54.330017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:54.361801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 123/245] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:54.369129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170faca6-9881-41a6-aea2-e87272e0befa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:54.385300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.409663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:54.410291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.410571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.410841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.504489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769a877-9e97-4571-a7e4-7fde6c6b4b5b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:54.505107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:54.508069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:54.552990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:54.563897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:54.564564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.564843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.565757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.589590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:54.596182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:54.597116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:54.597979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:54.598752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 124/246] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:54.605286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.639548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 123/247] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:54.641342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.650748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:54.735244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b07d9-7067-429a-82fb-2fed75c8d5b9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:54.782208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:54.783037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.783372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.783998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.784866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:54.785174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:54.787469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:54.789446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db42c5-076c-4b10-8e87-16c9d73cdeeb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:54.798442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 125/248] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:54.804616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.872436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:54.873364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.873798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.874210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.875541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:54.877106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:54.879023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 124/249] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:54.888103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:54.897489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:54.910129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:54.912653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe4046-f485-46cd-9f14-039eb9c31f59 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:54.952342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:54.953521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:54.954097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:54.954547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] PATH_INFO: `/v3/users/624d73234b894c788f660e138e193d8d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:54.956579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] RBAC: Authorizing `identity:get_user(user_id=624d73234b894c788f660e138e193d8d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:54.958041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:54.959813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 126/250] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/users/624d73234b894c788f660e138e193d8d => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:54.976197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:55.106545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e798c-9bf5-450d-8af1-ed54682de9b3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:55.163766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:55.164422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.164705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.165153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.165966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] RBAC: Adding query filter params (role.id=eef65fdb7e6246b8bd58121c962366e3, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=523e5814ee964b86a6e6072f2f5c9405) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:55.166274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:55.167800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56a7a-21bf-4185-9bb9-87415da7f990 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:55.185422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 125/251] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/role_assignments?user.id=523e5814ee964b86a6e6072f2f5c9405&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=eef65fdb7e6246b8bd58121c962366e3 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:55.188519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c829a-3f9b-4234-9e9f-c723b518af44 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:55.236721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b3c1-2486-4b7a-824d-e202ad1bd699 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.237145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b3c1-2486-4b7a-824d-e202ad1bd699 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.237594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b3c1-2486-4b7a-824d-e202ad1bd699 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.239442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 126/252] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:55.240175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:55.240925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.241213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.241487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.243829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:55.244754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.245038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.245298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:55.245400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.247178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 127/253] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:54 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:55.253613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:55.264857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:55.266068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:55.316060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:55.334855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:55.343746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 127/254] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:55.370019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:55.440678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b971-f1f8-4bd7-b200-de1fe580491f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:55.488826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc700-919d-4229-b228-dfb6a2a69648 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:55.516990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:55.517776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.518066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.518880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/624d73234b894c788f660e138e193d8d/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.521789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46, user_id=624d73234b894c788f660e138e193d8d, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:55.523387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:55.529052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:55.529701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.529974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.530241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.542966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:55.548247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:55.549141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:02:55.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:02:55.550703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 128/255] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:02:55.555820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:55.567404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 128/256] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:55 2022] PUT /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/624d73234b894c788f660e138e193d8d/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:02:55.622205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:55.671108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e8440-e50b-475c-a1e1-8dcc33add45e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:55.709642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:55.710269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.710543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.710810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.711559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:55.711859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:55.713239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:55.723805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 129/257] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:55.729411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:55.848736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:55.855812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384a4b-9330-48c1-b946-3878606e2529 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:55.896491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:55.897050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:55.897324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:55.897592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] PATH_INFO: `/v3/users/70b90a1cd94b49f5a3955e21998e4922` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:55.898746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=70b90a1cd94b49f5a3955e21998e4922)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:55.900235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:55.902112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 129/258] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:55 2022] GET /identity/v3/users/70b90a1cd94b49f5a3955e21998e4922 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:55.907530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:56.013045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9f86-38db-493f-94c4-a37ca67523a6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:56.030634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:56.048119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:56.048872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:56.049157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:56.050507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:56.120866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:56.122603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:56.238901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 130/259] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:56.244383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:56.367501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec8410-be2d-4855-a90b-95c1fad4d2a6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:56.411009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50f0a-81d1-47dc-8abe-0d9a0b11ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:56.411677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50f0a-81d1-47dc-8abe-0d9a0b11ecaa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:56.411951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50f0a-81d1-47dc-8abe-0d9a0b11ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:56.412215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50f0a-81d1-47dc-8abe-0d9a0b11ecaa None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:56.413363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a50f0a-81d1-47dc-8abe-0d9a0b11ecaa None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:56.414810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a50f0a-81d1-47dc-8abe-0d9a0b11ecaa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:56.416818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 130/260] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:56 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:56.422949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:56.459571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:56.468402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523e40-4fa3-4a34-ba6d-48b475e1b9d4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:56.468707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523e40-4fa3-4a34-ba6d-48b475e1b9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:56.468950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523e40-4fa3-4a34-ba6d-48b475e1b9d4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:56.473257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 131/261] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:56.476938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:56.477601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:56.478077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:56.500606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:56.502818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:56.558664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:56.567050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a117-27d5-4bba-8a21-845a04906e32 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:56.636819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 132/262] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:56.653156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:56.653767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:56.654048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:56.654318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:56.655102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=70b90a1cd94b49f5a3955e21998e4922) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:56.655434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:56.656867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:56.668024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 131/263] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:56 2022] GET /identity/v3/role_assignments?user.id=70b90a1cd94b49f5a3955e21998e4922&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:56.674053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:56.838950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95db3e3-ecaf-4d4e-b642-a7bbb2a2b455 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:56.887869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:56.888519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:56.888797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:56.889061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:56.905144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:56.910938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:56.911863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:56.912663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 133/264] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:56.920052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:57.051936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:57.075126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec95ca6-a3f8-4ea6-8aae-3b23c1b3e248 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:57.115173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:57.115797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:57.116077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:57.116349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:57.117110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:57.117412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:57.118786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:57.130585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 132/265] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:02:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:57.137060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:57.179878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:57.287471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867185a-2853-4918-8094-d4e4cdaa677b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:57.327517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888065d1-e44b-48cb-abdf-70a7647f7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:57.328084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888065d1-e44b-48cb-abdf-70a7647f7a5b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:57.328362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888065d1-e44b-48cb-abdf-70a7647f7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:57.328629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888065d1-e44b-48cb-abdf-70a7647f7a5b None admin] PATH_INFO: `/v3/users/70b90a1cd94b49f5a3955e21998e4922` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:57.329810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888065d1-e44b-48cb-abdf-70a7647f7a5b None admin] RBAC: Authorizing `identity:get_user(user_id=70b90a1cd94b49f5a3955e21998e4922)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:57.332451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888065d1-e44b-48cb-abdf-70a7647f7a5b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:57.334392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 134/266] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:57 2022] GET /identity/v3/users/70b90a1cd94b49f5a3955e21998e4922 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:57.339718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:57.490127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb60c-7c7a-4ca8-bb4b-55f5801770cd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:57.537623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:57.538634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:57.539116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:57.539630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:57.561249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:57.646524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:57.648365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:57.700653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e582d8-a558-474b-8700-0024efa283dc None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:57.701607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e582d8-a558-474b-8700-0024efa283dc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:57.702089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e582d8-a558-474b-8700-0024efa283dc None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:57.703944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 135/267] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:57.709317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663f2ef-2187-40b8-8b8e-f000bee58ecd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:57.709865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663f2ef-2187-40b8-8b8e-f000bee58ecd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:57.710341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663f2ef-2187-40b8-8b8e-f000bee58ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:57.729270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f663f2ef-2187-40b8-8b8e-f000bee58ecd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:57.730779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f663f2ef-2187-40b8-8b8e-f000bee58ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:57.817326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 133/268] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:57.823798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:57.850447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 136/269] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:02:57.897046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d4f7d-f693-4223-8270-56000d3ffbae None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:57.897648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d4f7d-f693-4223-8270-56000d3ffbae None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:57.898121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d4f7d-f693-4223-8270-56000d3ffbae None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:57.899471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:57.900473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 137/270] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:02:57.901380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d4f7d-f693-4223-8270-56000d3ffbae None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:57.924301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:57.965286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e0a4-1ada-4b8f-948d-d76e3939027b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.004486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50642a2-2bae-4293-85d5-22ef4d98cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.005546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50642a2-2bae-4293-85d5-22ef4d98cf7b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.006074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50642a2-2bae-4293-85d5-22ef4d98cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.006544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50642a2-2bae-4293-85d5-22ef4d98cf7b None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.007945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50642a2-2bae-4293-85d5-22ef4d98cf7b None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:58.009716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50642a2-2bae-4293-85d5-22ef4d98cf7b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:58.011677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 134/271] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:57 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:58.013111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.013598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.014067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.028661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d4f7d-f693-4223-8270-56000d3ffbae None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.033919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:58.035365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:58.076910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.078029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.078508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.078987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.080397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:58.082617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:58.084820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 138/272] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:58.085777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.135242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 135/273] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:58.136482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.193880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:58.194561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:58.210818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbce2d-d578-459b-96f9-64dd1188ded9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.245582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.246199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.246474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.246743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.247651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] RBAC: Adding query filter params (role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=70b90a1cd94b49f5a3955e21998e4922) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:58.247952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:58.249497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86331e4-95e1-401a-8769-82b3233aec69 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:58.263338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 139/274] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/role_assignments?user.id=70b90a1cd94b49f5a3955e21998e4922&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:58.263338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34398b0-cabc-4666-89b8-37eef6c2517f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.263586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482e43f-10f1-49b6-ac6b-3e9b52ae81ba None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.263690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34398b0-cabc-4666-89b8-37eef6c2517f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.263690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34398b0-cabc-4666-89b8-37eef6c2517f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.263690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 140/275] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:58.263690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34398b0-cabc-4666-89b8-37eef6c2517f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.305848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89845-c452-44c5-95fe-8be201ca9fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.306612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89845-c452-44c5-95fe-8be201ca9fef None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.306959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89845-c452-44c5-95fe-8be201ca9fef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.307371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89845-c452-44c5-95fe-8be201ca9fef None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.308231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89845-c452-44c5-95fe-8be201ca9fef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:58.309813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89845-c452-44c5-95fe-8be201ca9fef None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:58.337580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 136/276] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:02:58 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:02:58.339038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496619a-bd0e-4fcc-8fe3-26551433fc7c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.339469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496619a-bd0e-4fcc-8fe3-26551433fc7c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.340262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496619a-bd0e-4fcc-8fe3-26551433fc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.361959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1496619a-bd0e-4fcc-8fe3-26551433fc7c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:58.364057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1496619a-bd0e-4fcc-8fe3-26551433fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:58.407624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34398b0-cabc-4666-89b8-37eef6c2517f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.454659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 137/277] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:58.456657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385cc8-045d-4ef1-b669-664dbc1c54b9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.456948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385cc8-045d-4ef1-b669-664dbc1c54b9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.457223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385cc8-045d-4ef1-b669-664dbc1c54b9 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.458660 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 138/278] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:02:58.461177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.461177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.461177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.461177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.464930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.465509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.465779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.474249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:58.484404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:58.485438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:58.486246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 141/279] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:58.487117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.489103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:02:58.490914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:02:58.508494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:58.532157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:58.592564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 139/280] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:02:58.596053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.633783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c149a-7a8a-4bd6-abab-977c7b738a46 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.676225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.676889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.677167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.677439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.691214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:58.696760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:58.697832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 142/281] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:58.698799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.725484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3655e-27ab-4f85-aace-b4a61cca174c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.764182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.765372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.765657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.766158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.767598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:58.767970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:58.773293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:58.786209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 140/282] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:58.788042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.816813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:58.817029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:58.821134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d73fa-f3c8-406f-9024-2a8ec3b667a8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.872536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.873486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.873927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.874350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.890160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:02:58.896904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:02:58.897808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:02:58.898608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:02:58.900916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 143/283] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:02:58.901908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:58.922139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ce02-0aaf-475c-a8b0-33b991c5b58f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:58.978800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:58.979290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:58.979700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:58.980057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:58.980937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:58.981357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:58.982809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:58.993175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 141/284] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:58.997882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.031427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2311b-879a-4c06-a1d3-3133325d092f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.062410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.086602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.086602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.086602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.086602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] PATH_INFO: `/v3/users/73e51dace4504729b14a0001a5e931df` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.106625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=73e51dace4504729b14a0001a5e931df)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.108297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.110110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 144/285] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/users/73e51dace4504729b14a0001a5e931df => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:59.110961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.121383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.149216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcfe20-16c8-4709-8db1-3b52c7880bdc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.192469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.193098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.193426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.193699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.194359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:59.194661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.196411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.208049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 142/286] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:02:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:59.214238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.258183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe65-0414-4e37-9d13-a2e1f9b0d5d2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.305390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.306436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.306919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.307444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] PATH_INFO: `/v3/users/624d73234b894c788f660e138e193d8d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.308801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] RBAC: Authorizing `identity:get_user(user_id=624d73234b894c788f660e138e193d8d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.310552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.312904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:59 2022] GET /identity/v3/users/624d73234b894c788f660e138e193d8d => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:59.314016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.342842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40597cdc-4f40-4369-8163-8055dcb6bdb0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.383408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.389399 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.390018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.390298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.390568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.391386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, user.id=73e51dace4504729b14a0001a5e931df, scope.system=all) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:02:59.391694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.393542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.399672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 143/288] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 05:02:59 2022] GET /identity/v3/role_assignments?user.id=73e51dace4504729b14a0001a5e931df&scope.system=all&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:59.400830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.413755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.446481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa472-933b-4349-a4fb-a7eadf23f39f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.493783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.495124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.495884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.496391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] PATH_INFO: `/v3/users/523e5814ee964b86a6e6072f2f5c9405` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.498435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] RBAC: Authorizing `identity:get_user(user_id=523e5814ee964b86a6e6072f2f5c9405)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.500561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.503182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 146/289] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:02:59 2022] GET /identity/v3/users/523e5814ee964b86a6e6072f2f5c9405 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:02:59.509496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.521757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70399c5-1493-4ebe-b4f6-fae368b40abd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.567483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.568225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.568603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.569043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.621461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f221-5049-42ef-b902-edfea6acb829 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.648113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.661410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.662784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.663310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.663810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.665244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.666077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.667198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.667557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.669324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 147/290] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:59 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:02:59.676869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.680082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.788426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e1dd-24e0-484f-a6af-a62286996e52 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.791963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 144/291] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:02:59.797272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:02:59.855118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.856409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.856830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.857244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/523e5814ee964b86a6e6072f2f5c9405/roles/eef65fdb7e6246b8bd58121c962366e3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.859365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46, user_id=523e5814ee964b86a6e6072f2f5c9405, role_id=eef65fdb7e6246b8bd58121c962366e3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.860972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.895317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 148/292] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:02:59 2022] PUT /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/users/523e5814ee964b86a6e6072f2f5c9405/roles/eef65fdb7e6246b8bd58121c962366e3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:02:59.930526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48eac4-544f-447d-9999-23dc872db81e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:02:59.950049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:02:59.992599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd7cec-3e2e-497f-bec6-39e98f360d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:02:59.994469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7cec-3e2e-497f-bec6-39e98f360d98 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:02:59.994469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7cec-3e2e-497f-bec6-39e98f360d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:02:59.994469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7cec-3e2e-497f-bec6-39e98f360d98 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:02:59.995342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd7cec-3e2e-497f-bec6-39e98f360d98 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:02:59.996953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd7cec-3e2e-497f-bec6-39e98f360d98 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:02:59.999077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 145/293] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:02:59 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:00.004593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:00.110372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:00.257296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55055f-2a61-41d5-9d4f-18060a8dc4c5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:00.318334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:00.318966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:00.319275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:00.319683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:00.320336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=624d73234b894c788f660e138e193d8d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:00.320644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:00.322099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77c23-b03c-40a7-8e22-51551d1785cf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:00.329249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 149/294] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:00 2022] GET /identity/v3/role_assignments?user.id=624d73234b894c788f660e138e193d8d&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:00.932769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f521ba-3a03-41f9-a9cb-800f32cc4364 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:00.933282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f521ba-3a03-41f9-a9cb-800f32cc4364 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:00.933393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f521ba-3a03-41f9-a9cb-800f32cc4364 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:00.934936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 146/295] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:00.941397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d00ee7-38d6-42aa-b7f2-d8868450f875 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:00.941906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d00ee7-38d6-42aa-b7f2-d8868450f875 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:00.941981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d00ee7-38d6-42aa-b7f2-d8868450f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:00.966937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-76d00ee7-38d6-42aa-b7f2-d8868450f875 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:00.968169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-76d00ee7-38d6-42aa-b7f2-d8868450f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:01.047550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 150/296] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:01.072186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f521ba-3a03-41f9-a9cb-800f32cc4364 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:01.115654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33954-905e-4739-a93d-4f4d31d05459 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.116288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33954-905e-4739-a93d-4f4d31d05459 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.116743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33954-905e-4739-a93d-4f4d31d05459 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.118296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 151/297] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:01.123236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.123744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.124147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.146706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:01.148012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:01.184521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f521ba-3a03-41f9-a9cb-800f32cc4364 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:01.205012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:01.219275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:01.219912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.220207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.220469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.231636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:01.236352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 152/298] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:01.236477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:01.238467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:01.239321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:01.242493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 147/299] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:01.252234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:01.265081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:01.305666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:01.369294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96723-d5e7-4ab8-b9ca-300ac8b721ba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:01.373855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68aa53-2000-483d-8b18-528523842a09 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:01.411509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:01.412615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.413144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.413559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.414528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:01.414872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:01.415181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:01.415541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.415826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.416102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.417268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:01.417398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:01.418689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:01.420326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 148/300] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:01.426922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:01.428454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 153/301] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:01.436647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:01.481798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:01.539436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c382-6f73-4ed3-9938-eb1f7623c54b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:01.541794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:01.554473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2b18e-8e73-42da-b4ee-3b4165ebfbcb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:01.576989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:01.577915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.577915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.578123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] PATH_INFO: `/v3/groups` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.578800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:01.580271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:01.595289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cace7-991e-49c0-b6d7-b7b034f20135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:01.596400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cace7-991e-49c0-b6d7-b7b034f20135 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.597134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cace7-991e-49c0-b6d7-b7b034f20135 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.597557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cace7-991e-49c0-b6d7-b7b034f20135 None admin] PATH_INFO: `/v3/users/a1ced820b4a840ecbd55f80fbf08bcd0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.603373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 149/302] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Aug 5 05:03:01 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:01.621783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cace7-991e-49c0-b6d7-b7b034f20135 None admin] RBAC: Authorizing `identity:get_user(user_id=a1ced820b4a840ecbd55f80fbf08bcd0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:01.623663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cace7-991e-49c0-b6d7-b7b034f20135 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:01.626124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 154/303] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:03:01 2022] GET /identity/v3/users/a1ced820b4a840ecbd55f80fbf08bcd0 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:01.633110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:01.754203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03baf1-bffd-466d-a750-57a104f405bf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:01.793986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:01.794667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.794952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.795320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.796108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] RBAC: Adding query filter params (role.id=eef65fdb7e6246b8bd58121c962366e3, user.id=a1ced820b4a840ecbd55f80fbf08bcd0, scope.system=all) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:01.796468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:01.797930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639403c-5505-45bf-bf1c-113e3b12c240 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:01.804309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 150/304] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 05:03:01 2022] GET /identity/v3/role_assignments?user.id=a1ced820b4a840ecbd55f80fbf08bcd0&scope.system=all&role.id=eef65fdb7e6246b8bd58121c962366e3 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:01.854294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1324-e86b-4e0c-af18-47e6f009fd46 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.854676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1324-e86b-4e0c-af18-47e6f009fd46 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.854891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1324-e86b-4e0c-af18-47e6f009fd46 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.856476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 155/305] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:01.862758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:01.863308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:01.863612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:01.883823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:01.885043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:01.913240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:01.968790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 151/306] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:01.991483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1324-e86b-4e0c-af18-47e6f009fd46 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.095633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:02.103789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1324-e86b-4e0c-af18-47e6f009fd46 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.141062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665d38a-79cb-4df7-a375-9fec3d0cd455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.141951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d38a-79cb-4df7-a375-9fec3d0cd455 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.142377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d38a-79cb-4df7-a375-9fec3d0cd455 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.142794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d38a-79cb-4df7-a375-9fec3d0cd455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.153458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665d38a-79cb-4df7-a375-9fec3d0cd455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0665d38a-79cb-4df7-a375-9fec3d0cd455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:02.159107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:02.160182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:02.161184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:02.163185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 156/307] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:02.169509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.274013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb5eed-1a8a-4fcb-a712-6db5534fe4a4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.311144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.311789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.312063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.312345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.313036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:02.313332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:02.314695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:02.317978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70656dd-9dec-47da-9bae-4f56c6c35f25 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.318260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70656dd-9dec-47da-9bae-4f56c6c35f25 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.318531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70656dd-9dec-47da-9bae-4f56c6c35f25 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.321140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 157/308] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:02.323863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 152/309] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:02.325483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.325774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.326048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.329395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.344454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:02.345696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:02.352236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:02.436248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cf573-8cee-4fcc-8adc-3f0be21bfa73 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.443888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 158/310] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:02.465023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.488728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.489969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.490636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.491437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] PATH_INFO: `/v3/users/73e51dace4504729b14a0001a5e931df` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.493134 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] RBAC: Authorizing `identity:get_user(user_id=73e51dace4504729b14a0001a5e931df)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:02.495467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:02.497988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 153/311] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:03:02 2022] GET /identity/v3/users/73e51dace4504729b14a0001a5e931df => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:02.504870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.573697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64b4cf-2eee-4975-9876-39518a5566ba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.591519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:02.596696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:02.609615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0d7ea-8217-4445-8ba1-181d7fc142bd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.612297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.613665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.614083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.614489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.625971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:02.632440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:02.633966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:02.635850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:02.639736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 159/312] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:02.646508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.658311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.659547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.660303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.660599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] PATH_INFO: `/v3/system/users/73e51dace4504729b14a0001a5e931df/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.662500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=73e51dace4504729b14a0001a5e931df, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:02.664201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:02.680007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 154/313] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Aug 5 05:03:02 2022] PUT /identity/v3/system/users/73e51dace4504729b14a0001a5e931df/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:02.769891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc169606-00c9-4218-bb1f-1dd6403daa67 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.810243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.811290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.811792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.812318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.813252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:02.813755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:02.816012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:02.831006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 160/314] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:02.832515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:02.939740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8aa05e-66b2-4ecd-83c8-7f5776f2aba6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:02.977435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:02.978075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:02.978333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:02.978610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] PATH_INFO: `/v3/users/523e5814ee964b86a6e6072f2f5c9405` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:02.979786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] RBAC: Authorizing `identity:get_user(user_id=523e5814ee964b86a6e6072f2f5c9405)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:02.981220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:02.983123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 155/315] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:03:02 2022] GET /identity/v3/users/523e5814ee964b86a6e6072f2f5c9405 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:02.989120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:03.007723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:03.094944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116937d7-0085-4272-9ed9-aef346a1b586 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:03.130568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:03.131208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.131527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.131801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.202189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:03.203611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:03.214146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:03.313940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 161/316] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:03.319998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:03.342909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:03.426757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec35b0-7bfc-4134-8479-e87e560f1e14 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:03.461146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bfabb-fe98-4256-8653-aab5adcbe2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:03.461699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bfabb-fe98-4256-8653-aab5adcbe2cd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.461977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bfabb-fe98-4256-8653-aab5adcbe2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.462247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bfabb-fe98-4256-8653-aab5adcbe2cd None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.463437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bfabb-fe98-4256-8653-aab5adcbe2cd None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:03.464888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bfabb-fe98-4256-8653-aab5adcbe2cd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:03.466855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 156/317] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:03 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:03.473256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:03.582147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36189-5643-4bab-8cdd-c8dd2a5516e7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:03.591888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:03.618457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:03.619314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.619735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.620177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.621096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] RBAC: Adding query filter params (role.id=eef65fdb7e6246b8bd58121c962366e3, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46, user.id=523e5814ee964b86a6e6072f2f5c9405) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:03.621545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:03.623133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f8e0f-eafc-4b49-8d2e-38384a9664d3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:03.630298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 162/318] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:03 2022] GET /identity/v3/role_assignments?user.id=523e5814ee964b86a6e6072f2f5c9405&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=eef65fdb7e6246b8bd58121c962366e3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:03.878250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3572ee-a08e-4efc-b78f-4e962f079cbf None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.878620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3572ee-a08e-4efc-b78f-4e962f079cbf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.878825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3572ee-a08e-4efc-b78f-4e962f079cbf None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.880371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 157/319] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:03.885394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.885798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.885971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.887032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a022c07-cbaa-4600-b1a9-75dce91a3843 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.887354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a022c07-cbaa-4600-b1a9-75dce91a3843 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.887636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a022c07-cbaa-4600-b1a9-75dce91a3843 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.889002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 158/320] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:03.895670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:03.895966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:03.896239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:03.904496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:03.905681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:03.914919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:03.916124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:03.982546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 163/321] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:03.987095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 159/322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:04.004782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.008849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.027501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:04.111524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451bb95-90f6-4739-aca9-fbc4aeea7147 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:04.114658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb799114-267a-44b1-8dd5-06fb149b331a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:04.116330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:04.149458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:04.150022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.150308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.150584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.151729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:04.152969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:04.153222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:04.153968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.154411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.154980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 160/323] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:04.155305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.161836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.170155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:04.176224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:04.177122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:04.177933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:04.182261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 164/324] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:04.183056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.257737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:04.274359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e3a5-b556-48dc-bee1-0905af07307f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:04.288623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb426a-6b8a-434c-bf25-b5555f4c07bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:04.314290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:04.315946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.316234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.316506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] PATH_INFO: `/v3/groups` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.317162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:04.318582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:04.324882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:04.325503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.325854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.326058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.326798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:04.327102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:04.328602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:04.335232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 161/325] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Aug 5 05:03:04 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:03:04.343210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 165/326] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:04.349006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.460318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086baecd-a61b-4f32-9d45-0100d908d611 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:04.496384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25c844-14b4-47e2-a443-eedd307b3aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:04.497020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25c844-14b4-47e2-a443-eedd307b3aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.497298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25c844-14b4-47e2-a443-eedd307b3aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.497567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25c844-14b4-47e2-a443-eedd307b3aa7 None admin] PATH_INFO: `/v3/users/a1ced820b4a840ecbd55f80fbf08bcd0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.498724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25c844-14b4-47e2-a443-eedd307b3aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=a1ced820b4a840ecbd55f80fbf08bcd0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:04.500210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25c844-14b4-47e2-a443-eedd307b3aa7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:04.507227 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 162/327] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:03:04 2022] GET /identity/v3/users/a1ced820b4a840ecbd55f80fbf08bcd0 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:04.508464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.535325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:04.622541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0038-5683-4a3e-882b-ecc512d27516 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:04.659342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3036851-14f4-4e19-9918-61c737fe8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:04.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3036851-14f4-4e19-9918-61c737fe8805 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.660305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3036851-14f4-4e19-9918-61c737fe8805 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.660582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3036851-14f4-4e19-9918-61c737fe8805 None admin] PATH_INFO: `/v3/system/users/a1ced820b4a840ecbd55f80fbf08bcd0/roles/eef65fdb7e6246b8bd58121c962366e3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.662064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3036851-14f4-4e19-9918-61c737fe8805 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a1ced820b4a840ecbd55f80fbf08bcd0, role_id=eef65fdb7e6246b8bd58121c962366e3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:04.663495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3036851-14f4-4e19-9918-61c737fe8805 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:04.675695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 166/328] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Aug 5 05:03:04 2022] PUT /identity/v3/system/users/a1ced820b4a840ecbd55f80fbf08bcd0/roles/eef65fdb7e6246b8bd58121c962366e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:03:04.752684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88e6c-fef7-4a95-93a4-60a617040b06 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.752871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88e6c-fef7-4a95-93a4-60a617040b06 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.753154 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88e6c-fef7-4a95-93a4-60a617040b06 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.754556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 163/329] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:04.760405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:04.760687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:04.760951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:04.782091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:04.785511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:04.874264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 167/330] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:04.899289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c88e6c-fef7-4a95-93a4-60a617040b06 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:04.917596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:05.017388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c88e6c-fef7-4a95-93a4-60a617040b06 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:05.057437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:05.058137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:05.058525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:05.058800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:05.072748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:05.078554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:05.079492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:05.080354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 164/331] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:05.087931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:05.110832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:05.213126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334f621-e4af-4f4b-a207-b67aa35473ee None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:05.249218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:05.249837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:05.250113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:05.250383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:05.251171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:05.251479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:05.252919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:05.269910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 168/332] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:05.275409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:05.385535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:05.417370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68a111-94e6-4265-bd20-d3aee278cb78 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:05.460742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7bc25-af6f-44af-a7d4-be5ef6563a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:05.461394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7bc25-af6f-44af-a7d4-be5ef6563a6b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:05.461672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7bc25-af6f-44af-a7d4-be5ef6563a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:05.461944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7bc25-af6f-44af-a7d4-be5ef6563a6b None admin] PATH_INFO: `/v3/users/73e51dace4504729b14a0001a5e931df` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:05.463175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7bc25-af6f-44af-a7d4-be5ef6563a6b None admin] RBAC: Authorizing `identity:get_user(user_id=73e51dace4504729b14a0001a5e931df)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:05.464631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7bc25-af6f-44af-a7d4-be5ef6563a6b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:05.466553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 165/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:03:05 2022] GET /identity/v3/users/73e51dace4504729b14a0001a5e931df => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:05.472046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:05.583730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:05.605805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bf21-33db-4e3b-bbdd-8f7223eabdf6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:05.644493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:05.645463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:05.645955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:05.646433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:05.647435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] RBAC: Adding query filter params (role.id=ba3e5daf3db54f9d86f49e343563059f, user.id=73e51dace4504729b14a0001a5e931df, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:05.647934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:05.649566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286842fe-9bfb-45b5-a7c4-0562b1f132df None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:05.667672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 169/334] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 05:03:05 2022] GET /identity/v3/role_assignments?user.id=73e51dace4504729b14a0001a5e931df&scope.system=all&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:06.901767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d008-07f0-4d60-b154-94611b45987a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:06.902792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d008-07f0-4d60-b154-94611b45987a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:06.903292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d008-07f0-4d60-b154-94611b45987a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:06.905148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 166/335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:06.910668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b821-9768-4f3d-95c9-777a2f69878f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:06.911591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b821-9768-4f3d-95c9-777a2f69878f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:06.912055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b821-9768-4f3d-95c9-777a2f69878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:06.940872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0660b821-9768-4f3d-95c9-777a2f69878f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:06.942423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0660b821-9768-4f3d-95c9-777a2f69878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:07.041866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 170/336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:07.078205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d008-07f0-4d60-b154-94611b45987a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:07.121246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac95107-fa12-4390-aaa3-345f01a3b87f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.121862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac95107-fa12-4390-aaa3-345f01a3b87f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.122324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac95107-fa12-4390-aaa3-345f01a3b87f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.124189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 171/337] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:07.129986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077571-f2e4-49df-9159-ff393196e490 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.130548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077571-f2e4-49df-9159-ff393196e490 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.131009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78077571-f2e4-49df-9159-ff393196e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.159989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-78077571-f2e4-49df-9159-ff393196e490 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:07.164397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-78077571-f2e4-49df-9159-ff393196e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:07.299912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:07.302425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d008-07f0-4d60-b154-94611b45987a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:07.315739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 172/338] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:07.347017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78077571-f2e4-49df-9159-ff393196e490 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:07.370278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:07.370921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.371213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.371485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.400343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:07.406533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:07.407475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:07.408291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 167/339] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:07.416343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:07.422254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:07.563056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78077571-f2e4-49df-9159-ff393196e490 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:07.612912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a334e1-9114-4cf5-8ee3-f7517f33c709 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:07.633863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48a1a-f9cd-4229-8749-01f5e76cff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:07.634525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48a1a-f9cd-4229-8749-01f5e76cff93 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.634806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48a1a-f9cd-4229-8749-01f5e76cff93 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.635080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48a1a-f9cd-4229-8749-01f5e76cff93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.663236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:07.664005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.664287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.664556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.665264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:07.665562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:07.667039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:07.668045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e48a1a-f9cd-4229-8749-01f5e76cff93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-34e48a1a-f9cd-4229-8749-01f5e76cff93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:07.672982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:07.674331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:07.675236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 173/340] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:07.676370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 168/341] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:07.677175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf606-4a6a-4d66-bce6-75b9272a1e34 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.677672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf606-4a6a-4d66-bce6-75b9272a1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.678158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf606-4a6a-4d66-bce6-75b9272a1e34 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.680077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 174/342] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:07.687336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:07.688775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.689057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.689328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.724143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:07.725327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:07.758251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:07.821569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0869a-d7e2-4d48-9921-b65ba9f583ba None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:07.858634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:07.871532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:07.872157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:07.872438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:07.872712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:07.888237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 175/343] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:07.889088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.006473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.007895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.063551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255efb1-1037-4f3d-8f1f-7a8715301db8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.102355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.103071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.103418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.103686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.104489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:08.104789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.106251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.110056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:08.117750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 176/344] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:08.118576 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.185745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:08.188799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 169/345] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:08.190415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.278509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f2f5-5fe5-4d0e-b18e-1935ad5d155b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.336862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.337522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.337787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.338056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.347492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fbe8-06c6-4704-83d3-c899158ac76d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.359188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:08.360130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:08.361040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:08.362552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 177/346] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:08.363267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.403044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.403732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.404012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.404286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] PATH_INFO: `/v3/users/a1ced820b4a840ecbd55f80fbf08bcd0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.405456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a1ced820b4a840ecbd55f80fbf08bcd0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.407064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.410261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 170/347] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/users/a1ced820b4a840ecbd55f80fbf08bcd0 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:08.411057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.460546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:08.506128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08556c14-84da-4a5c-9408-86b435b030a6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.519587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:08.549894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185e75-b3b2-433d-b695-691e7e2a53b2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.551059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7de3-e661-4e63-95f0-3b9e9638f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.552024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7de3-e661-4e63-95f0-3b9e9638f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.552305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7de3-e661-4e63-95f0-3b9e9638f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.552578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7de3-e661-4e63-95f0-3b9e9638f7e7 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.554606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec7de3-e661-4e63-95f0-3b9e9638f7e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.556147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec7de3-e661-4e63-95f0-3b9e9638f7e7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.557829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 178/348] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:08.559650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1a70-0693-4024-b1eb-71786164700d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.559932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1a70-0693-4024-b1eb-71786164700d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.560204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1a70-0693-4024-b1eb-71786164700d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.561826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 179/349] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:08.567465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1a70-0693-4024-b1eb-71786164700d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.598055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.599239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.599526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.599983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.600867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:08.601358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.603070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee942df-611b-4022-8228-ee521d01a3ed None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.613956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 171/350] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:08.615223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cf620-4924-426f-be0e-c1928750837b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.615580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cf620-4924-426f-be0e-c1928750837b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.615782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cf620-4924-426f-be0e-c1928750837b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.618390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 172/351] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:08.618390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cf620-4924-426f-be0e-c1928750837b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.704077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1a70-0693-4024-b1eb-71786164700d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.748459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.749167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.749379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.749646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.750548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] RBAC: Adding query filter params (role.id=eef65fdb7e6246b8bd58121c962366e3, user.id=a1ced820b4a840ecbd55f80fbf08bcd0, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:08.750854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.754426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0e4fa-f826-49e0-b957-3846826830ca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.756777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:08.767609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cf620-4924-426f-be0e-c1928750837b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:08.771375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 180/352] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/role_assignments?user.id=a1ced820b4a840ecbd55f80fbf08bcd0&scope.system=all&role.id=eef65fdb7e6246b8bd58121c962366e3 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:08.772870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.773389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.773905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.794583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:08.796261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:08.805494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e914f-89cf-469f-bfe7-7e757a38e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:08.806069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e914f-89cf-469f-bfe7-7e757a38e226 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.806344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e914f-89cf-469f-bfe7-7e757a38e226 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.806615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e914f-89cf-469f-bfe7-7e757a38e226 None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.813332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e914f-89cf-469f-bfe7-7e757a38e226 None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:08.815970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e914f-89cf-469f-bfe7-7e757a38e226 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:08.817968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 173/353] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:08.819031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:08.819346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:08.819617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:08.840167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:08.844457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:08.845694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:08.892757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 181/354] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:08.894628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:08.940873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 174/355] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:08.941735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.022957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc34bd9-398c-44bb-9610-7542446459a8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.054655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:09.069617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb3314-f009-466a-8291-1b29bdf016f6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.070713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.072031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.072509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.072992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.107644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.108221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.108703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.108809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.109624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:09.109919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:09.111433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:09.117844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 175/356] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:09.118463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.124668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:09.172344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:09.173805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:09.296355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 182/357] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:09.297223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.325027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24829f0-c949-4642-a591-514a455d0ac3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.370783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bac328-c33d-424a-9810-b5d4e8d77a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.371639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bac328-c33d-424a-9810-b5d4e8d77a02 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.371748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bac328-c33d-424a-9810-b5d4e8d77a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.372006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bac328-c33d-424a-9810-b5d4e8d77a02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.385328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bac328-c33d-424a-9810-b5d4e8d77a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:09.389475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-52bac328-c33d-424a-9810-b5d4e8d77a02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:09.392636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:09.393612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:09.394430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 176/358] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:09.395749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837be7-1014-4e80-a552-3e6f2ee530f5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.395749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837be7-1014-4e80-a552-3e6f2ee530f5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.395749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837be7-1014-4e80-a552-3e6f2ee530f5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.397079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 177/359] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:09.401545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95837be7-1014-4e80-a552-3e6f2ee530f5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.413871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:09.441384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe7f24-87bd-4188-8280-c47f3e0c7baf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.488358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.489157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.489440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.489710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.505070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:09.510049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:09.511027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:09.511966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:09.513190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 183/360] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:09.513265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.532771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95837be7-1014-4e80-a552-3e6f2ee530f5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.576701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26227eeb-c3cc-428c-9f55-4af7496f0aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.577671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26227eeb-c3cc-428c-9f55-4af7496f0aba None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.578183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26227eeb-c3cc-428c-9f55-4af7496f0aba None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.578688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26227eeb-c3cc-428c-9f55-4af7496f0aba None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.583765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26227eeb-c3cc-428c-9f55-4af7496f0aba None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:09.585346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26227eeb-c3cc-428c-9f55-4af7496f0aba None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:09.587417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 178/361] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:09.589668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.590004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.590280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.610449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:09.611723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:09.654254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb95b5-91af-42b4-ae8b-2bc0e978031f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.687553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:09.699436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.700107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.700390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.700670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.701465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:09.701768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:09.703141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:09.704570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 179/362] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:09.706201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.712373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 184/363] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:09.713188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.725518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:09.846603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c58cd2-17e6-4221-9e97-6182b5724cff None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.846771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27112e8-dd68-49ea-9f27-c594add96f9e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:09.887769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.888386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.888662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.888928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.889630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:09.889926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:09.891305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:09.892319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:09.893498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:09.893781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:09.894058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:09.895223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:09.896666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:09.898303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 185/364] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:09.899057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.905706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 180/365] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:09.906815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:09.968003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.007252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.039056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e24647-fc06-40a0-a161-b0abd5223edd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.052055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ce890-4fce-4889-887c-1a4bd3b50c39 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.086377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.088267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.088267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.088267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.095331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.097688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.097688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.097688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.108840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:10.115432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:10.116381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:10.117177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 181/366] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:10.117838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.188813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.192040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:10.257048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8173b-b50a-44d2-a615-dbe77b9aea65 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.265912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.294555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.304060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.304699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.304979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.305252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.306518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:10.306518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.308030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:10.315005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 182/367] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:10.315974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.336955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 186/368] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:10.338176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.447751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858f26-26c2-4aa4-82d0-3e09a6cce8da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.457938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e4f8-141d-4fee-8f65-9a4c499249de None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.491091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.492314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.492314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.492464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.499032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.499687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.499970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.500243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.500957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:10.501257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.502873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:10.512007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 187/369] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:10.512821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.544952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.572170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.579608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.582322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:10.665086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940865e-a3b8-4574-b66b-09174637980e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.713557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 183/370] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:10.713819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.714563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.714933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.715240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.715405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.716783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.718397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:10.722503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 188/371] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:10.727705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.832257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.839804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:10.850859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81e95-9813-4d43-a554-78445452b37d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.865964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510dc8d-7a7d-48eb-9ce3-bd322268fed7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:10.894788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.895437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.895760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.895988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.912757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:10.914093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:10.914770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:10.915210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:10.917209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.918894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:10.921580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 189/372] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:10.922495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:10.984181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:10.985639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.055799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb669-c0b0-4d93-9f96-9d6ecdfd6497 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.090218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.097713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 184/373] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:11.098625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.099175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.100272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.100687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.101092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.102432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.104136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.106204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 190/374] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:10 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.107249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.139514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.213192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad88dc-8462-4769-bfa4-72d98190a257 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.228689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a2ae-aae2-47a7-8fcc-346a6e5591aa None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.249879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.250697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.250814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.251036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.252281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.253786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.255832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 185/375] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.256568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.266000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.266863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.267310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.268517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] PATH_INFO: `/v3/projects/7c86c1e82858454b999fb55324c5aeed` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.269853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] RBAC: Authorizing `identity:get_project(project_id=7c86c1e82858454b999fb55324c5aeed)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.271815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.273888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 191/376] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/projects/7c86c1e82858454b999fb55324c5aeed => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.274922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.334272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.380226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77cd5-86c3-4f3d-bad2-55833e09920e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.383370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.392892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271e6b-0ad4-4853-9a4c-ee645229695f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.419031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.419681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.419957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.420226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.420997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:11.421302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.422716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.430487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 186/377] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.431127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.444738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.445695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.446556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.447303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.448836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:11.449578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.452236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe462-ad6b-4db5-81b1-fbdb339eef5f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.461624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 192/378] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.467719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce73a3-b2ec-490b-88ed-bd092720fa8c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.468379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce73a3-b2ec-490b-88ed-bd092720fa8c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.468920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce73a3-b2ec-490b-88ed-bd092720fa8c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.470894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 193/379] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:11.485349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.485901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.487443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.516810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:11.524297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:11.597412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29199-a9c8-4709-aeab-0f51dea6fdd3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.620726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 194/380] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:11.652649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.661034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.666818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.667504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.667784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.668057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] PATH_INFO: `/v3/groups/cf552667c49a4701a231eeb4467b7b3a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.678622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] RBAC: Authorizing `identity:get_group(group_id=cf552667c49a4701a231eeb4467b7b3a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.678622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.680172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 187/381] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/groups/cf552667c49a4701a231eeb4467b7b3a => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.687427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.775570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.795760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac457a5-0990-43af-8b25-46520e6639e7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.801787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f0acf-23bf-4738-9359-c91c3d62c28e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:11.837913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.838282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:11.838933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.839239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.839508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.839771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:11.840249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:11.840349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] RBAC: Adding query filter params (group.id=cf552667c49a4701a231eeb4467b7b3a, role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=7c86c1e82858454b999fb55324c5aeed) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:11.840579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:11.841000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:11.841998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:11.848641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 188/382] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/role_assignments?group.id=cf552667c49a4701a231eeb4467b7b3a&scope.project.id=7c86c1e82858454b999fb55324c5aeed&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:11.854469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:11.859920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:11.860896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:11.862643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:11.865741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 195/383] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:11.871530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:11.939170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:11.991037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bd49f-9464-41e5-a83a-392ebcfebdbd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:12.030375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:12.030973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:12.031291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:12.031560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:12.032262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:12.032560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:12.034151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:12.043243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 189/384] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:12.050691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:12.167551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d58805-464e-4e1a-85f1-8a8796658273 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:12.210425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:12.211068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:12.211369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:12.211638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:12.212764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:12.214210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:12.216126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 196/385] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:12 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:12.222405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:12.331821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb45051-e1dd-4ffb-97c6-0b87b72952d5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:12.349198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:12.367051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf2bc-e186-4b20-b415-4af487002703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:12.367723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf2bc-e186-4b20-b415-4af487002703 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:12.368002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf2bc-e186-4b20-b415-4af487002703 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:12.368274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf2bc-e186-4b20-b415-4af487002703 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:12.369489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf2bc-e186-4b20-b415-4af487002703 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:12.370961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf2bc-e186-4b20-b415-4af487002703 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:12.372946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 190/386] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:12 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:12.379053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:12.394858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:12.512871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5fe0-71ae-4cf2-abd5-baf38394f1b5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:12.566365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604cc8-73b0-483e-a39f-222932273acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:12.567041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604cc8-73b0-483e-a39f-222932273acb None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:12.567347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604cc8-73b0-483e-a39f-222932273acb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:12.567618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604cc8-73b0-483e-a39f-222932273acb None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/groups/cd389d91a6c7483d901b85d877a7303b/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:12.571884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604cc8-73b0-483e-a39f-222932273acb None admin] RBAC: Authorizing `identity:create_grant(project_id=0dc12badcb1f4c97a86d74fe7f35dba0, group_id=cd389d91a6c7483d901b85d877a7303b, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:12.573333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604cc8-73b0-483e-a39f-222932273acb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:12.603192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 197/387] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 05:03:12 2022] PUT /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/groups/cd389d91a6c7483d901b85d877a7303b/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:03:12.763017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f85a13-3da8-4fda-acc6-61abf7bcc3af None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:12.763412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f85a13-3da8-4fda-acc6-61abf7bcc3af None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:12.763580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f85a13-3da8-4fda-acc6-61abf7bcc3af None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:12.765153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 191/388] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:12.771760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:12.772059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:12.772296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:12.791755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:12.792993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:12.879748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 198/389] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:12.901796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f85a13-3da8-4fda-acc6-61abf7bcc3af None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:13.009421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f85a13-3da8-4fda-acc6-61abf7bcc3af None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:13.044456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:13.045089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:13.045365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:13.045632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:13.056788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:13.062166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:13.064303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:13.066830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 192/390] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:13.075189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:13.078234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:13.179206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669bf9-4684-438f-bcd3-22e361e1b27a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:13.211923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:13.212548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:13.212821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:13.213144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:13.213864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:13.214162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:13.215630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:13.224927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 199/391] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:13.230327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:13.278557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:13.335887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46495f-a229-4fad-8169-95ed0d31208c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:13.370787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:13.371448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:13.371725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:13.371994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:13.373133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:13.374632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:13.376588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 193/392] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:13 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:13.381978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:13.448829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:13.488150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110355-8aab-40b6-bcce-5dbab44e15bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:13.522487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43254b98-6f26-4327-82b8-ae9837126cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:13.523128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43254b98-6f26-4327-82b8-ae9837126cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:13.523433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43254b98-6f26-4327-82b8-ae9837126cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:13.523705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43254b98-6f26-4327-82b8-ae9837126cf8 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:13.524846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43254b98-6f26-4327-82b8-ae9837126cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:13.526285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43254b98-6f26-4327-82b8-ae9837126cf8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:13.528253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 200/393] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:13 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:13.534033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:13.637569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bd35-6419-430f-bc6c-d4cd3ad3609c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:13.652091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:13.672642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85459ca-d434-4556-9ea1-be69783e7255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:13.673345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85459ca-d434-4556-9ea1-be69783e7255 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:13.673627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85459ca-d434-4556-9ea1-be69783e7255 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:13.674429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85459ca-d434-4556-9ea1-be69783e7255 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/groups/cd389d91a6c7483d901b85d877a7303b/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:13.676656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85459ca-d434-4556-9ea1-be69783e7255 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dc12badcb1f4c97a86d74fe7f35dba0, group_id=cd389d91a6c7483d901b85d877a7303b, role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:13.678070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85459ca-d434-4556-9ea1-be69783e7255 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:13.692903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 194/394] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 05:03:13 2022] PUT /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0/groups/cd389d91a6c7483d901b85d877a7303b/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:14.126284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645506-0839-4b48-9526-7ca9bcb5fd95 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.126591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645506-0839-4b48-9526-7ca9bcb5fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.126909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645506-0839-4b48-9526-7ca9bcb5fd95 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.128825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 201/395] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:14.133824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.134106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.134380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.160340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:14.161571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:14.248553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 195/396] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:14.283324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa645506-0839-4b48-9526-7ca9bcb5fd95 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:14.395863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa645506-0839-4b48-9526-7ca9bcb5fd95 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:14.427185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:14.432464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946474dd-e730-46cb-95a7-6aeaa8b6d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:14.433108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946474dd-e730-46cb-95a7-6aeaa8b6d501 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.433858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946474dd-e730-46cb-95a7-6aeaa8b6d501 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.434161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946474dd-e730-46cb-95a7-6aeaa8b6d501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.447470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946474dd-e730-46cb-95a7-6aeaa8b6d501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-946474dd-e730-46cb-95a7-6aeaa8b6d501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:14.452782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:14.453711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:14.454559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 202/397] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:14.461062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:14.537742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686dfa3-7daa-463a-b671-e7bc0e7e0c51 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.538096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686dfa3-7daa-463a-b671-e7bc0e7e0c51 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.538283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686dfa3-7daa-463a-b671-e7bc0e7e0c51 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.539938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 203/398] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:14.544614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1e8b2-204c-44b8-bc7b-c8ca391e21c5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.544897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1e8b2-204c-44b8-bc7b-c8ca391e21c5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.545171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1e8b2-204c-44b8-bc7b-c8ca391e21c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.574986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3369c-13ca-473c-a6a8-cf8f9d59ba8e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:14.579452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:14.587186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7ec1e8b2-204c-44b8-bc7b-c8ca391e21c5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:14.588393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ec1e8b2-204c-44b8-bc7b-c8ca391e21c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:14.629467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:14.630094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.630373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.630646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.631388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:14.631692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:14.633242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00a7de-9988-4d5a-90f6-264b12e8e7e1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:14.644492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 196/399] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:14.645936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77edd66-94dd-453f-9556-f3bc2e5e655f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.646165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77edd66-94dd-453f-9556-f3bc2e5e655f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.646435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77edd66-94dd-453f-9556-f3bc2e5e655f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.647934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 197/400] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:14.649903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77edd66-94dd-453f-9556-f3bc2e5e655f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:14.679601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 204/401] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:14.680970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad002a7-a642-4869-a767-26095e06144a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.681262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad002a7-a642-4869-a767-26095e06144a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.681530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad002a7-a642-4869-a767-26095e06144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.700691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bad002a7-a642-4869-a767-26095e06144a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:14.701983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bad002a7-a642-4869-a767-26095e06144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:14.799260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 205/402] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:14.800282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad002a7-a642-4869-a767-26095e06144a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:14.821160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77edd66-94dd-453f-9556-f3bc2e5e655f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:14.859640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:14.860855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.861439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.861990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.863490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:14.865249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:14.872067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 198/403] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:14 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:14.872351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:14.872457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:14.917345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:14.938144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad002a7-a642-4869-a767-26095e06144a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:14.976502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:14.977564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:14.978055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:14.978552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:14.990044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:14.990667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b250c1-dec3-4072-bd94-6f54119b1552 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:14.995818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:14.996703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:14.997500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:14.999923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 206/404] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:15.000903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.033091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.033979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.034259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.034540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.047238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:15.054915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:15.055984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 199/405] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:15.056866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.125394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe0d8-4d09-4864-b247-40d569897cce None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.140838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.161556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.167532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.168423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.168892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.169348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.171378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.173889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.181104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19acf9-5f7d-41fa-8988-325efe53f078 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.181750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 207/406] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.183565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.216385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.217115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.217460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.217837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.218659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:15.219075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.220711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.230704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 200/407] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.231608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.293545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613de4d7-5b08-4a52-a315-481c310da634 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.336827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.337439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.337836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.338111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.338928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:15.339274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.340751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d9351-7245-47fd-965f-f424fa744fd1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.344031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102ddc4-f132-4e15-aa8d-e6f99b101cd6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.354000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 208/408] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.354000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730999-7069-4688-bcb0-510decda72f3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.354000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730999-7069-4688-bcb0-510decda72f3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.354000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730999-7069-4688-bcb0-510decda72f3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.354000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 209/409] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:15.354000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730999-7069-4688-bcb0-510decda72f3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.391731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.392408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.392688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.393013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/groups/cd389d91a6c7483d901b85d877a7303b/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.395070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] RBAC: Authorizing `identity:create_grant(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46, group_id=cd389d91a6c7483d901b85d877a7303b, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.396594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.405129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.419270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 201/410] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 05:03:15 2022] PUT /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/groups/cd389d91a6c7483d901b85d877a7303b/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:15.419270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.445139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.485722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730999-7069-4688-bcb0-510decda72f3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.526530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f289ac-785e-4575-aeec-6f32c65a4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.527195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f289ac-785e-4575-aeec-6f32c65a4de4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.527481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f289ac-785e-4575-aeec-6f32c65a4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.527752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f289ac-785e-4575-aeec-6f32c65a4de4 None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.529031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f289ac-785e-4575-aeec-6f32c65a4de4 None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.530616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f289ac-785e-4575-aeec-6f32c65a4de4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.532456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 210/411] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.534770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.535064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.535361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.556005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:15.557212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:15.563809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3548e0-9153-49f3-8215-6b664dcc26cb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.613086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.613736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.614021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.614297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] PATH_INFO: `/v3/groups/cf552667c49a4701a231eeb4467b7b3a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.615665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] RBAC: Authorizing `identity:get_group(group_id=cf552667c49a4701a231eeb4467b7b3a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.617824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.621612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 202/412] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/groups/cf552667c49a4701a231eeb4467b7b3a => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.622804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.640447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 211/413] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:15.641572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.692645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.733924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.758954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c07eb-3ca7-41c2-a8f0-6a5108f63599 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.760762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2058b-86e3-4a2b-9546-7ba5f11117f4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.804065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.804704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.804977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.805245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] PATH_INFO: `/v3/projects/7c86c1e82858454b999fb55324c5aeed` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.806495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] RBAC: Authorizing `identity:get_project(project_id=7c86c1e82858454b999fb55324c5aeed)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.807949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.809903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 212/414] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/projects/7c86c1e82858454b999fb55324c5aeed => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.810798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.811773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.812665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.813453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.813955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.816461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.818135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:15.820616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 203/415] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:15.822023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:15.931489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c3526-c49a-4c42-8538-51e6e4e9b93a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.941692 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:15.952813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c7f5d-b93a-4de4-ba2c-b6b80a7f38fe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:15.976873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.978132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.979036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.979681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.989531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:15.990349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:15.990724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:15.991315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] PATH_INFO: `/v3/projects/7c86c1e82858454b999fb55324c5aeed/groups/cf552667c49a4701a231eeb4467b7b3a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:15.993333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c86c1e82858454b999fb55324c5aeed, group_id=cf552667c49a4701a231eeb4467b7b3a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:15.994542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:15.995019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:16.001138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:16.002274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:16.003051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:16.007298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 213/416] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:16.008235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:16.021508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 204/417] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 05:03:15 2022] PUT /identity/v3/projects/7c86c1e82858454b999fb55324c5aeed/groups/cf552667c49a4701a231eeb4467b7b3a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:16.022273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:16.045501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:16.142102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f90f-da3d-466a-aea7-732e4fb67588 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:16.185350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fd9ba-9eb9-45a4-8ddf-070513070a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:16.186293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd9ba-9eb9-45a4-8ddf-070513070a5f None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.186578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd9ba-9eb9-45a4-8ddf-070513070a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.186850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd9ba-9eb9-45a4-8ddf-070513070a5f None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/groups/cd389d91a6c7483d901b85d877a7303b/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.191358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd9ba-9eb9-45a4-8ddf-070513070a5f None admin] RBAC: Authorizing `identity:create_grant(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46, group_id=cd389d91a6c7483d901b85d877a7303b, role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:16.192750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8727c-e50a-4fd6-bb99-48d9729e3d26 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:16.192874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd9ba-9eb9-45a4-8ddf-070513070a5f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:16.210011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 214/418] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 05:03:16 2022] PUT /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46/groups/cd389d91a6c7483d901b85d877a7303b/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:16.211000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff783b5-5be7-42a9-8494-137016d1481b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.211325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff783b5-5be7-42a9-8494-137016d1481b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.211597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff783b5-5be7-42a9-8494-137016d1481b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.213195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 215/419] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:16.218387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed092e-b091-4410-810f-91217b519351 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.218807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed092e-b091-4410-810f-91217b519351 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.219348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed092e-b091-4410-810f-91217b519351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.241001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:16.241585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-05ed092e-b091-4410-810f-91217b519351 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:16.242148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.242609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.243038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-05ed092e-b091-4410-810f-91217b519351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:16.243293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.244243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:16.244734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:16.247741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:16.262632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 205/420] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:16.269803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:16.293371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:16.378058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:16.404264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 216/421] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:16.414391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710234-4523-4a51-9aed-2aac99d37323 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:16.428342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed092e-b091-4410-810f-91217b519351 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:16.462360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:16.463469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.463945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.464733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.571444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed092e-b091-4410-810f-91217b519351 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:16.618678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:16.618678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.618678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.618678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.623094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:16.624956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:16.643924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:16.654740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:16.655707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:16.656521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:16.659181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 217/422] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:16.664968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:16.709395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:16.787527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:16.825823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 206/423] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:16.836159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:16.859658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3a27-ef94-4439-bbc7-a86e3b1ba75b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:16.933427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:16.935783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:16.936949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:16.937423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:16.938360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:16.940039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:16.942919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:16.958465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 218/424] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:16.962124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:17.017727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09e72-81be-46d0-ab7c-7c82235b7b48 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:17.091626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:17.100419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:17.101075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.101353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.101736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.103055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:17.104419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:17.106545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 207/425] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:16 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:17.111813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:17.113060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c72ac-6500-49ba-8d7c-4b4b54cd0922 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:17.153089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:17.154589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.155281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.157620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.191500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:17.295302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:17.297652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:17.302824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cf9f2-3e6f-4212-bb0a-460155d217a5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:17.371857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:17.375849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.376126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.376396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.379442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:17.380883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:17.382812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 208/426] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:17 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:17.388247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:17.421308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:17.442395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 219/427] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:17.447814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:17.586239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996c005-3394-44a3-844a-f8df9240fb6c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:17.604638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:17.641864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194cfc3-373c-433b-b767-667ecbace651 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:17.653714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:17.654331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.654606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.654872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.655678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:17.655980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:17.657388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:17.669412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 209/428] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:17 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 611 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:17.705089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f9fdd-35db-4e94-8d3f-9940077f715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:17.705751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f9fdd-35db-4e94-8d3f-9940077f715c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.706114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f9fdd-35db-4e94-8d3f-9940077f715c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.706383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f9fdd-35db-4e94-8d3f-9940077f715c None admin] PATH_INFO: `/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.707598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f9fdd-35db-4e94-8d3f-9940077f715c None admin] RBAC: Authorizing `identity:get_project(project_id=0dc12badcb1f4c97a86d74fe7f35dba0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:17.709051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f9fdd-35db-4e94-8d3f-9940077f715c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:17.710984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 220/429] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:17 2022] GET /identity/v3/projects/0dc12badcb1f4c97a86d74fe7f35dba0 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:17.716373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:17.726532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3eba3-ee66-403d-aca6-843fb28a3fd5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.726802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3eba3-ee66-403d-aca6-843fb28a3fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.727070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3eba3-ee66-403d-aca6-843fb28a3fd5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.731252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 221/430] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:17.735185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.735480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.735751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.770836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:17.772167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:17.865723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:17.896797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 222/431] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:17.902504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c4df4-7186-4150-84ff-947d4247f911 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:17.927553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:17.939933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:17.940616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:17.940897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:17.941543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:17.943036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:17.944593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:17.946680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 210/432] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:17 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:17.953245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.063550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:18.066873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186866-ff4a-412a-a569-66a98177d1f4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.089626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28732a-aa3d-4ce7-93bd-d251b699205e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.119830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.120613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.121012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.121383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.128130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.129001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.129527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.129937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.130966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:18.131442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:18.133028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:18.133519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:18.138922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:18.139866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 05:03:18.140666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:18.143415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 223/433] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:18.144433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 211/434] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:17 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=0dc12badcb1f4c97a86d74fe7f35dba0&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:18.151286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.206876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:18.278685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad3170-14e3-4559-914a-538f6737aad6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.320786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.321676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.322107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.322520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.323405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:18.323848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:18.325712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8ce2e-0217-4906-a3b5-33a046e70ecb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:18.338960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 224/435] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:18.341372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.358504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe91a7-da5d-46d6-9999-28de40a7083a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.359011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe91a7-da5d-46d6-9999-28de40a7083a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.359566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe91a7-da5d-46d6-9999-28de40a7083a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.361826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 225/436] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:18.367905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.368375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.368785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.388370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:18.389767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:18.476041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 226/437] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:18.482462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca3c60-7563-4129-a476-772a5fdaac01 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.491235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:18.501872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.522496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db2dc-5636-49cc-9050-f890e8bbf7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.523476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db2dc-5636-49cc-9050-f890e8bbf7cd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.523929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db2dc-5636-49cc-9050-f890e8bbf7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.524386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db2dc-5636-49cc-9050-f890e8bbf7cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.543115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:18.604401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db2dc-5636-49cc-9050-f890e8bbf7cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:18.605876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db2dc-5636-49cc-9050-f890e8bbf7cd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:18.634123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b4658-6a26-4919-b0d7-c686c2484fdf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.674546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66a16-1142-4180-ae30-c8ca99a8c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.675255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66a16-1142-4180-ae30-c8ca99a8c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.675534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66a16-1142-4180-ae30-c8ca99a8c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.675805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66a16-1142-4180-ae30-c8ca99a8c2a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.685612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66a16-1142-4180-ae30-c8ca99a8c2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-47b66a16-1142-4180-ae30-c8ca99a8c2a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:18.691120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:18.692014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:18.692812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 227/438] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:18.693498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858406-08db-40fc-af39-6d864cc39392 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.693649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858406-08db-40fc-af39-6d864cc39392 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.693914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858406-08db-40fc-af39-6d864cc39392 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.695392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 228/439] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:18.698789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6858406-08db-40fc-af39-6d864cc39392 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.721241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 212/440] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:18.722485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.722780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.723053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.734573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:18.741590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:18.742800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:18.797734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:18.810812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6858406-08db-40fc-af39-6d864cc39392 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.824854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 213/441] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:18.825618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.850225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.850852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.851529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.851808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.852525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:18.852829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:18.854205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:18.862958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 229/442] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:18.863814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.949297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11eb9-c638-4757-88fc-5efaec5dbf5d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.970330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f9be-6adf-46ff-9eea-43354c6798a7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:18.983122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:18.983793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:18.984073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:18.984343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:18.985556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:18.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:18.989288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 214/443] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:18.990048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:18.994442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.015250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.015898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.016178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.016449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.031635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:19.037255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:19.038159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:19.038961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 230/444] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:19.039666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.058168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.102425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0b888-0836-4d95-9135-a9aface09a18 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.137865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.138485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.138766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.139042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.151388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f4c1-3d96-49e5-a0f8-737ff02346b1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.188912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.189605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.189928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.190247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.191437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.192939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.194518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 231/445] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:19.195307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.216913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.218398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.221925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.285902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.305671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf08e4-28cd-40d0-aca2-735c6da30480 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.329307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 215/446] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:19.329307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.340228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.340834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.341113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.341377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.342110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:19.342407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.343812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.353170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 232/447] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:19.353877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.443669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e104c-9298-4138-ac93-6e9734e2a63a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.445972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.460080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b887-0fdd-4002-8b2c-3a4b0daabcdc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.487138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.487798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.488042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.488307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.489081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ba3e5daf3db54f9d86f49e343563059f, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:19.489505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.490939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.495302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.495943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.496224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.496500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] PATH_INFO: `/v3/projects/7c86c1e82858454b999fb55324c5aeed` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.496851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 216/448] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ba3e5daf3db54f9d86f49e343563059f => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:19.497882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.497985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] RBAC: Authorizing `identity:get_project(project_id=7c86c1e82858454b999fb55324c5aeed)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.499339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.501073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 233/449] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/projects/7c86c1e82858454b999fb55324c5aeed => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:19.507107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.526196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.634768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5f48-d51c-4764-b2f0-0fca70d201ec None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.640664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678248d5-c117-4ad6-8173-7c4b9e940f0c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.679759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.680419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.680701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.680977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] PATH_INFO: `/v3/groups/cf552667c49a4701a231eeb4467b7b3a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.682691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] RBAC: Authorizing `identity:get_group(group_id=cf552667c49a4701a231eeb4467b7b3a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.684191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.685962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 234/450] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/groups/cf552667c49a4701a231eeb4467b7b3a => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:19.692397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:19.694102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.694733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.695273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.695604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.733920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.775349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.776808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.784777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:19.809773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7222d7-55da-45d0-8a15-ba98ae06ecba None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:19.853077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:19.853693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:19.853967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:19.854235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:19.855018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] RBAC: Adding query filter params (group.id=cf552667c49a4701a231eeb4467b7b3a, role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=7c86c1e82858454b999fb55324c5aeed) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:19.855377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:19.856804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:19.864348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 235/451] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/role_assignments?group.id=cf552667c49a4701a231eeb4467b7b3a&scope.project.id=7c86c1e82858454b999fb55324c5aeed&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:19.899269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 217/452] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:19.904966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:20.010505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05285e88-8462-4eb8-93de-6a82855e523c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:20.046557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:20.047222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:20.047501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:20.047767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] PATH_INFO: `/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:20.049911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] RBAC: Authorizing `identity:get_project(project_id=42bb9cf81b9b41bbb97a7c800a8e7d46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:20.051374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:20.053183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 236/453] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:03:19 2022] GET /identity/v3/projects/42bb9cf81b9b41bbb97a7c800a8e7d46 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:20.058494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:20.124385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:20.155751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb99af-d5bd-4627-bf92-3fd617857fdf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:20.189383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354d488-137f-4c7c-8ee7-97a038855c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:20.190016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354d488-137f-4c7c-8ee7-97a038855c37 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:20.190287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354d488-137f-4c7c-8ee7-97a038855c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:20.190553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354d488-137f-4c7c-8ee7-97a038855c37 None admin] PATH_INFO: `/v3/groups/cd389d91a6c7483d901b85d877a7303b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:20.191692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354d488-137f-4c7c-8ee7-97a038855c37 None admin] RBAC: Authorizing `identity:get_group(group_id=cd389d91a6c7483d901b85d877a7303b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:20.193124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354d488-137f-4c7c-8ee7-97a038855c37 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:20.194689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 218/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 05:03:20 2022] GET /identity/v3/groups/cd389d91a6c7483d901b85d877a7303b => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:20.200675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:20.213028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:20.297466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600321a-0ee2-4dad-b77c-08a8ad329265 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:20.330480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:20.331074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:20.331388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:20.331659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:20.332430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] RBAC: Adding query filter params (group.id=cd389d91a6c7483d901b85d877a7303b, role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:20.332734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:20.334148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849f6c-1e54-4e8a-91a5-7838831fe174 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:20.339731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 237/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 05:03:20 2022] GET /identity/v3/role_assignments?group.id=cd389d91a6c7483d901b85d877a7303b&scope.project.id=42bb9cf81b9b41bbb97a7c800a8e7d46&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:22.874066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208089-eff0-412f-8ec4-92d61f0fd2f8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:22.875113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208089-eff0-412f-8ec4-92d61f0fd2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:22.875625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208089-eff0-412f-8ec4-92d61f0fd2f8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:22.877970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 219/456] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:22.883092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310c95-fd61-43e1-9d7b-2cbedafee44c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:22.883947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310c95-fd61-43e1-9d7b-2cbedafee44c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:22.884409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310c95-fd61-43e1-9d7b-2cbedafee44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:22.906977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-58310c95-fd61-43e1-9d7b-2cbedafee44c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:22.908644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58310c95-fd61-43e1-9d7b-2cbedafee44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:23.005493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 238/457] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:23.048182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208089-eff0-412f-8ec4-92d61f0fd2f8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:23.191843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208089-eff0-412f-8ec4-92d61f0fd2f8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:23.238037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:23.238934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.239202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd138-3ad4-4b35-a730-82ca6c1abf33 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.239420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.239698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.240126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd138-3ad4-4b35-a730-82ca6c1abf33 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.240765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbd138-3ad4-4b35-a730-82ca6c1abf33 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.242574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 239/458] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:23.246406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:23.247811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37acc5-2275-470d-9bee-24ed32dcc8cc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.248664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37acc5-2275-470d-9bee-24ed32dcc8cc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.249142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37acc5-2275-470d-9bee-24ed32dcc8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.257214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:23.258665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:23.272998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3b191e7a-62dc-4e70-8b1e-4bc068bdab58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:23.278452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:23.281679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 220/459] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7201-ea81-4804-a3a0-1def4d9b7b6d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7201-ea81-4804-a3a0-1def4d9b7b6d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.282681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7201-ea81-4804-a3a0-1def4d9b7b6d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.287029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7c37acc5-2275-470d-9bee-24ed32dcc8cc None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:23.287278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 221/460] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:23.288640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a7201-ea81-4804-a3a0-1def4d9b7b6d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:23.288899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7c37acc5-2275-470d-9bee-24ed32dcc8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:23.387188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 240/461] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:23.387188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.387188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.387188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.417793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:23.419633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:23.439073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a7201-ea81-4804-a3a0-1def4d9b7b6d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:23.477016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:23.478051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.478533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.479003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.479901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:23.480403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:23.481995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:23.494007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 241/462] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:23.494912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:23.495988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 222/463] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:23.502623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:23.567019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:23.568333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:23.609760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b302f8-525a-4064-8410-da4a2ecd7cc4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:23.625157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cc7f5-c1b6-43b2-b6ed-82892e4406f1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:23.646219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:23.646854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.647177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.647530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.659036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:23.660506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:23.663015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f8565-6250-439a-b4c9-bf69b4e0b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:23.663890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f8565-6250-439a-b4c9-bf69b4e0b0d3 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.664404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f8565-6250-439a-b4c9-bf69b4e0b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.664894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f8565-6250-439a-b4c9-bf69b4e0b0d3 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.665757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f8565-6250-439a-b4c9-bf69b4e0b0d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:23.667517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f8565-6250-439a-b4c9-bf69b4e0b0d3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:23.676102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:23.677285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:23.678411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:23.678411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:23.678411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:23.678411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:23.678411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 242/464] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:23.678725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:23.695954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 223/465] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:03:23 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:23.697175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f399-22de-41b3-8a81-d77de45a6f6d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.697466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f399-22de-41b3-8a81-d77de45a6f6d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.697740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f399-22de-41b3-8a81-d77de45a6f6d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.699430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 224/466] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:23.704166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f399-22de-41b3-8a81-d77de45a6f6d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:23.823738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa979d6-99d0-4ead-9da9-fa58d41ebbac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:23.843374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:23.862748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f399-22de-41b3-8a81-d77de45a6f6d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:23.864531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:23.865259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.865615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.866020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.866408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:23.882245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:23.884626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4758e788-3ac8-42e5-a660-9fe9c00a97a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:23.900931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:23.901875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:23.902728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:23.902728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:23.902728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:23.902728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:23.902728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 243/467] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:23.904310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.904589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.904859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.923456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:23.924180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:23.924389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:23.924612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:23.925296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:23.925594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:23.927065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:23.927194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:23.928234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:23.940149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 225/468] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:23.940989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.000313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 244/469] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:24.001184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.061396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cfa86-e452-4513-b659-94c073e9bbe1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.110657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.112341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.112623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.113169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.113869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:24.114207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.116239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.127615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:24.131818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83b1d-7973-43c7-8091-f833bc94ec76 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.135276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 226/470] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:24.136279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.168586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:24.176273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.176499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.176732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.176997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.177722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.179141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.208680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 245/471] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:03:24 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:24.209646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.292549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece21b-cb49-4c49-8a85-d21984121a3c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.332483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d39f2-3c7c-4a4f-a764-640c1136bf42 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.364507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.365437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.365717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.366233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.372002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cd5a0-4bb2-4244-a682-9921cd89f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.372636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cd5a0-4bb2-4244-a682-9921cd89f60f None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.372917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cd5a0-4bb2-4244-a682-9921cd89f60f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.373191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cd5a0-4bb2-4244-a682-9921cd89f60f None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.373875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cd5a0-4bb2-4244-a682-9921cd89f60f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.375493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cd5a0-4bb2-4244-a682-9921cd89f60f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.378710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.380125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5f877fc8-9026-42ce-b575-2c7c7ffbd49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:24.397947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:24.398878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:24.399859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:24.399859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:24.399859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:24.399859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:24.399859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 227/472] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:24.401213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dedb42-95f3-4941-97ac-40b9275cee00 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.401213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dedb42-95f3-4941-97ac-40b9275cee00 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.401213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dedb42-95f3-4941-97ac-40b9275cee00 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.402018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 228/473] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:24.406535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dedb42-95f3-4941-97ac-40b9275cee00 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.410086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 246/474] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:03:24 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:24.412665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.412665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.412665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.451806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:24.452939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:24.457341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:24.520593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:24.550679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dedb42-95f3-4941-97ac-40b9275cee00 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.559798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 247/475] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:24.583303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.592959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.593661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.594042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.594782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.595831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:24.596219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.598000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.612911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 229/476] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:24.617995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.715119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e190-52f6-41aa-93a6-57d1e64ce5e2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.751338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238070c3-aa38-449e-b21a-34e3700d00a0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.758130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.758869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.759268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.759646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.760520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.761984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.772158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.sql.core [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 05:03:24.772158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 05:03:24.772158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [parameters: {'id': '4f7081101f6b44c685cfcb04981900c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 05:03:24.772158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80353) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 05 05:03:24.790774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return ref.to_dict() Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 05:03:24.791823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application yield resource Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise self.value Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application session.commit() Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 05:03:24.792741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.flush() Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application compat.raise_( Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 05:03:24.793570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 05:03:24.794419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 05:03:24.795268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [parameters: {'id': '4f7081101f6b44c685cfcb04981900c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:24.796060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 05:03:24.796853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:24.797687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 248/477] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 05:03:24 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:24.799821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:24.802640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.803520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.803662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:24.804973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.804973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:24.805663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:24.807489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:24.819879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:24.838831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 230/478] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:03:24 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:24.950825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eaf08-c388-4f93-8fe6-39263ad3f052 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:24.998562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d198acb-d436-415f-bd5d-1ab7153c6309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:24.999183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198acb-d436-415f-bd5d-1ab7153c6309 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:24.999476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198acb-d436-415f-bd5d-1ab7153c6309 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:24.999755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198acb-d436-415f-bd5d-1ab7153c6309 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:25.010811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d198acb-d436-415f-bd5d-1ab7153c6309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6d198acb-d436-415f-bd5d-1ab7153c6309 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:25.016348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:25.017883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:25.018763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 249/479] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:03:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:25.025136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:25.135581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24d32-91de-4c2d-aae2-cc45d98285bb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:25.172401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:25.173017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:25.173331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:25.173616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:25.174382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:25.174680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:25.176124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddb745-f595-4cfb-99a1-368e4aa7a4e0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:25.184711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 231/480] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:26.127698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd862d5-834b-463b-8f64-9763a7cec708 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.128248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd862d5-834b-463b-8f64-9763a7cec708 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.128328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd862d5-834b-463b-8f64-9763a7cec708 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.129896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 250/481] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:26.135133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066447f-66cf-469f-a629-58802e9172cd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.135564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066447f-66cf-469f-a629-58802e9172cd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.135749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066447f-66cf-469f-a629-58802e9172cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.160942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f066447f-66cf-469f-a629-58802e9172cd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:26.164762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f066447f-66cf-469f-a629-58802e9172cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:26.246093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:26.274655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 232/482] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:26.312586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd862d5-834b-463b-8f64-9763a7cec708 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:26.399812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:26.454818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd862d5-834b-463b-8f64-9763a7cec708 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:26.504522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5aae0-e7e6-4947-bbf8-b411ce45f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:26.505216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5aae0-e7e6-4947-bbf8-b411ce45f736 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.505494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5aae0-e7e6-4947-bbf8-b411ce45f736 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.505757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5aae0-e7e6-4947-bbf8-b411ce45f736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.516184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5aae0-e7e6-4947-bbf8-b411ce45f736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a9c5aae0-e7e6-4947-bbf8-b411ce45f736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:26.522197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:26.523276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:26.524372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 251/483] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:26.533995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066447f-66cf-469f-a629-58802e9172cd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:26.646799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066447f-66cf-469f-a629-58802e9172cd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:26.685760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:26.686295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.686570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.686837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.687569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:26.687865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:26.689743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3f0ff-e3f8-40cc-a6a1-fa59b8a30941 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:26.696671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0b95-c0d6-479d-bc3c-51be1c578800 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.696953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0b95-c0d6-479d-bc3c-51be1c578800 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.697230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0b95-c0d6-479d-bc3c-51be1c578800 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.699052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 252/484] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:26.702925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 233/485] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:26.708538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0b95-c0d6-479d-bc3c-51be1c578800 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:26.709051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.709340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.709612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.728025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:26.729192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:26.778546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:26.805961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 234/486] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:26.832686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:26.944635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573baad9-4bb4-4d8e-a33a-48bea703eed7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:26.983145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:26.983809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:26.984230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:26.984504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:26.995223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:27.000857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:27.002994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:27.005050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 235/487] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:27.012392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0b95-c0d6-479d-bc3c-51be1c578800 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.012587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.059538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.076517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.077272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.077551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.077822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.081073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.098621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.098621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:27.114082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:27.115003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:27.115914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:27.115914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:27.115914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:27.115914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:27.118099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 253/488] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:27.126359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.175999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f666dd-3728-4ae0-a344-35150253198b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.222952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.223510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.223785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.224056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.224759 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:27.225057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.226421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.242403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 236/489] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:27.248163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.322401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c8a7-694e-4aab-bfaa-00d10c210b64 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.372500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.373121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.373403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.373674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.374893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:27.375228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.377132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f07714-a01c-4945-98e4-c53c69f554e4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.391075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 254/490] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:27.392559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fcc64-ae80-4467-b671-524eb53821d6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.392838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fcc64-ae80-4467-b671-524eb53821d6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.393160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fcc64-ae80-4467-b671-524eb53821d6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.398902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 255/491] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:27.400336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fcc64-ae80-4467-b671-524eb53821d6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.404627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.410520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e2df-18b2-4cc6-b337-10a1a3b75f64 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.444174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.450186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.451654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.451938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.452211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.471188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.471188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a7cac81c-a0c7-4eda-a1a1-0e112e879e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:27.482033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:27.482878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:27.483752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:27.483752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:27.483752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:27.483752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:27.483752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 237/492] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:27.487179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.487179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.487179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.505220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:27.506510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:27.519251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fcc64-ae80-4467-b671-524eb53821d6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.556390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.557069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.557351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.557725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.566745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.568277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.580433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 238/493] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:27.581285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:27.582837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:27.584563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:27.585649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 256/494] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:27.589729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.675481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.695386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.697553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe95-2537-44c3-8902-391406b215b7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.701797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c353b0-3653-4122-a2a0-a2a0f1938e3e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.735539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.736440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.736704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.736983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.737320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.737677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:27.737933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.738027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.738216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.738486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.739301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:27.739406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.739607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.741035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d3560-f706-40e5-ace1-a6dcf89c1df6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.756054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 239/495] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:27.756054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.787668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 257/496] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:27.787668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f050a41-5e81-4f61-ab79-23557efdc496 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.787668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f050a41-5e81-4f61-ab79-23557efdc496 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.787668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f050a41-5e81-4f61-ab79-23557efdc496 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.787668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 258/497] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:27.788132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f050a41-5e81-4f61-ab79-23557efdc496 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.868865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7061-9921-45b2-90b2-3ec3474d6cc7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.895263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f050a41-5e81-4f61-ab79-23557efdc496 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:27.903001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.903662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.903946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.904224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.912362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:27.917117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:27.922015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:27.922926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:27.923804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 240/498] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:27.924736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:27.932570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:27.933213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.933495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.933767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.941067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:27.942514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3a25fa22-02ba-48e8-8178-49d1f1fa7a6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:27.954110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:27.955728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:27.956624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 259/499] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:27.957366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b927932-2fe3-4ef5-902c-d04fe7351317 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:27.957366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b927932-2fe3-4ef5-902c-d04fe7351317 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:27.957493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b927932-2fe3-4ef5-902c-d04fe7351317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:27.975135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5b927932-2fe3-4ef5-902c-d04fe7351317 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:27.976344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5b927932-2fe3-4ef5-902c-d04fe7351317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:27.985351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.028097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9f0c-c720-4fbf-b108-3de4f6559da0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.043720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 260/500] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:28.045075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cbc2d-bbeb-4352-8570-4a68ff625e40 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.045366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cbc2d-bbeb-4352-8570-4a68ff625e40 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.045641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cbc2d-bbeb-4352-8570-4a68ff625e40 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.046877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 261/501] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:28.047589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cbc2d-bbeb-4352-8570-4a68ff625e40 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.075203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5706e90-4b4f-4ab7-ae44-c83b52f136db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.075876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706e90-4b4f-4ab7-ae44-c83b52f136db None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.076155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706e90-4b4f-4ab7-ae44-c83b52f136db None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.076426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706e90-4b4f-4ab7-ae44-c83b52f136db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.141329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.144189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5706e90-4b4f-4ab7-ae44-c83b52f136db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.146019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5706e90-4b4f-4ab7-ae44-c83b52f136db None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.150783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cbc2d-bbeb-4352-8570-4a68ff625e40 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.185520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.186134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.186415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.186687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.187458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:28.187760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.189924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.198021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 262/502] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:28.199048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.208231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.250813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 241/503] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:28.252618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.252904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.253174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.271560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:28.272741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:28.298800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528957-e3bf-43a3-8d8c-13f576120e89 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.332807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.333437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.333691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.333960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.334742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:28.335043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.336539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.338350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 242/504] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:28.339179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.359524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 263/505] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:28.359524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.371964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.420291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.444216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d14c3-edb5-40a6-b58c-f22df2032520 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.457367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7847a-0719-412c-ae70-49bc2c2493ef None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.479079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.479745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.480027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.480303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.490915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.491063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:28.491577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.491850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.492112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:28.495818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:28.496685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:28.497481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 243/506] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:28.498128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.502341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.503933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:28.518849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:28.519854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:28.520707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:28.520707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:28.520707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:28.520707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:28.520707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 264/507] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:28.520707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.594137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.603700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801b178-4a7d-4f74-a148-ee31e1045195 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.618567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c663f7-5b38-4bcb-bdfa-534f44e79687 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.633617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.637653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.638296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.638579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.638851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.649673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.651117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.652142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.652747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.653012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.653277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:28.665783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:28.666796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:28.667861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:28.667861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:28.667861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:28.667861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:28.667861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 244/508] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:28.667861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.723057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.724578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.766429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19b22-849b-4d38-9c94-47ccb5fb8690 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.802217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.802856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.803128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.803528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.815247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.816690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.818419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.827714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 265/509] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:28.828544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:28.832394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:28.833220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:28.834120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:28.834120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:28.834120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:28.834120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:28.834120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 245/510] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:28.834381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.851752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:28.932145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc7e24-f0f5-41e0-880b-a4c37db57ef1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.935773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec2ae-95d8-4499-964f-2eb98b6dd03b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:28.964097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.964691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.964964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.965234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.965897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:28.966192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.967586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.969654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73595835-c622-47ab-a136-5a09425444db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:28.970798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73595835-c622-47ab-a136-5a09425444db None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:28.970798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73595835-c622-47ab-a136-5a09425444db None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:28.971476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73595835-c622-47ab-a136-5a09425444db None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:28.972171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73595835-c622-47ab-a136-5a09425444db None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:28.972474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73595835-c622-47ab-a136-5a09425444db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:28.973833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73595835-c622-47ab-a136-5a09425444db None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:28.979664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 246/511] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:28.980447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:28.981710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 266/512] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:28.982338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73595835-c622-47ab-a136-5a09425444db None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.040578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.061723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.083885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73595835-c622-47ab-a136-5a09425444db None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.085949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538ae0-abf3-4949-ac4b-e1fdb1972efe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.116122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.116745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.117020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.117287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.120574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.121178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.121458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.121727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.122405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:29.122705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.124083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.127887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.129328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.135948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 247/513] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:29.136645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:29.147681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:29.148634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:29.149458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:29.149458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:29.149458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:29.149458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:29.149458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 267/514] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:29.149723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.236873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112472e-8727-4bf1-a716-4a8ee751d850 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.250048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.251309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e9903-b057-4dab-8efa-37885626c8d5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.270272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.270876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.271167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.271449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.272114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:29.272410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.273765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.280639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.286930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 248/515] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:29.287656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.288218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.288331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.288561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.288827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] PATH_INFO: `/v3/users/glance` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.297289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.299416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:29.310335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:29.311251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:29.312151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 268/516] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:29.312733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.393433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3889b-904e-4bc4-94eb-ebc8dbdc4bc9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.413682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45a84-1b05-43cf-948b-d273cc5d5bae None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.428127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.428762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.429039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.429311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.439968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.441420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.447956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.448585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.449113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.449380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.456181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:29.456483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:29.457302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:29.458140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:29.458140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:29.458140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:29.458140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:29.458345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.458411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 249/517] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:29.458411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:29.473896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:29.474765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:29.475676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 269/518] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:29.476130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.492715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.526424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.565291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665adbbd-d8f2-4281-bcfa-ef72785bd78d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.577118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae41a6-5da7-49a1-8bbd-1feee9bac735 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.598108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.598715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.598997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.599295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.599971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:29.600269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.601673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.609447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.610051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.610328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.611123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.611874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.613290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.614343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 250/519] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:29.615011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.634623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 270/520] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:03:29 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:29.635436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.719709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.738941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6c083-9900-4c72-8e2e-54833e0e6e30 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.743049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d19fa5-d041-4a00-900b-eee8bdf79ebc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.750632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:29.780848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.781470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.781745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.782012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.782138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.783358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:29.783526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.783745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.783857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.784048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.784988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:29.784988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.785471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.786473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.803324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 271/521] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:29.807716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.831989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 251/522] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:29.833699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.916735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c799fd-6dd1-438b-8091-feb488f620ea None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.941714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6449-69ee-433c-a13a-2ecf3ccf52cc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:29.950655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.951298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.951580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.951845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.952581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:29.952881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.954359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.977003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:29.977173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 272/523] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:29.977589 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:29.977873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:29.977981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:29.978139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:29.985056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:29.986716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:29.998806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:30.000000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 252/524] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:30.001053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.005191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.011214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.086140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175b086-70ff-4d30-b6fc-3e6f2a7a8ab0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.111775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772373c8-6b6b-4fee-ae51-fd90184659e3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.120151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.120790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.121068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.121336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.129283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.130744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:30.144178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:30.145295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 05:03:30.146409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:30.149703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.150332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.150611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.150880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.153421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 273/525] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:30.153421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.229963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.231369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.234748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.248084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.263641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5424-2e43-4a5d-bf03-ce18e8431344 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.301255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.301867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.302140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.302805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.303212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=097e3f30073e48ec832b53d8f89d0d16) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:30.303501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.304964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.310815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 274/526] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/role_assignments?user.id=097e3f30073e48ec832b53d8f89d0d16&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:30.312439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.347401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 253/527] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:30.347401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.457638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371b8e-8833-4f66-9847-13087d68f9fe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.481264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ffd95-809c-4a9f-bdbb-a1bd58b06c36 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.483696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.499015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.499670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.499950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.501783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.502559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:30.502875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.504392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.522871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 275/528] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:30.523796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.525692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.526808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.528246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.528838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.529818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:30.530314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.531961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.536840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.559103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 254/529] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:30.560406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.639547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92de2ce-5ebf-4218-b75e-3b8f19b63914 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.684202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.685703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.686127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.686794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.688485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4087-072a-4e8c-ac91-6e26aeb5f46e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.700170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.702454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:30.723349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:30.724430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:30.725480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:30.725480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:30.725480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:30.725480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:30.731697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.731697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.731697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.731697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.732084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=27ec934145884311899c8ebd19082646) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:30.732084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.732084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:30.732352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 276/530] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:30.733315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.743311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 255/531] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/role_assignments?user.id=27ec934145884311899c8ebd19082646&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:30.744415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:30.799680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.820749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:30.867000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535de1-2c3c-4103-af54-e042e3c454bd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.910088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:30.911029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:30.911484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:30.911895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:30.978995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d162-23ef-4846-a42b-2f616c07bc1d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:30.995567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:30.997481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.017921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.018834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.019275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.019700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.020571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:31.020966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.022433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.036859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 256/532] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:31.044656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:31.072828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:31.118736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 277/533] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:31.136093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:31.193223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:31.211530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08e0d7-8247-4fd9-9db1-69390fbbf2fa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:31.253698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.254266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.254553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.254827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.268661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.270816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:31.296153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:31.297042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:31.298518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 257/534] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:31.305774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:31.352487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab286-14cf-4b57-baa0-d16cd43006dd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:31.432201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.432859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.433141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.433412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.453560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932a60-32c4-47c5-a6b4-f66203d66880 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:31.456011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.457507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:31.474811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:31.476147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:31.477238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:31.477238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:31.477238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:31.477238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:31.477238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 278/535] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:31.481898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:31.519760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:31.534462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.535097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.535398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.535667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.536416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:31.536720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.538155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.584926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 258/536] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:31.590819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:31.601771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:31.688027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d555e-de33-4629-a8a1-aa864a644214 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:31.736402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.737111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.737401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.737678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.738375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:31.738678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.739668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdc02c-5395-405b-aed8-ddb67db7f3f9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:31.740099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.753464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 279/537] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:31.760135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:31.789240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.790602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.791288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.791816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.792927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=b35db16684ea4a4d9c6743bd3c094439) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:31.793588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.795235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.803519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 259/538] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/role_assignments?user.id=b35db16684ea4a4d9c6743bd3c094439&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:31.867604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:31.899585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e710f-a348-409b-a600-b6bed2b2e155 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:31.941614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:31.942645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:31.943126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:31.943677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:31.952071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:31.954031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5002f65c-1fef-4c19-9262-b20b41abf09e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:31.967764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:31.968711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:31.969552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:31.975543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 280/539] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:31.978914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:32.010320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f098a-61c5-49d8-93d1-7e358f24f11c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.010639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f098a-61c5-49d8-93d1-7e358f24f11c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.010881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f098a-61c5-49d8-93d1-7e358f24f11c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.012483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 281/540] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:32.018122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.018412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.018690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.044448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:32.046096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:32.063817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:32.097086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb2ee-4a25-4a5b-9319-5e7d92335336 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:32.132572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:32.133244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.133530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.133802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.134604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:32.134917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:32.136389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:32.149555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 260/541] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:32.160318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:32.169881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 282/542] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:32.244548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:32.344618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ad8a5-62d2-49cb-b6b7-8f4be7308efa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:32.364429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:32.406804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0020773-e3af-4fae-b41e-4a1bc7e209a9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:32.416597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:32.433203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:32.433829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.434112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.434384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.435190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=b5b9b3ac8ed94fc1831476c8d41323b4) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:32.435500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:32.436951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:32.451885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 261/543] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:32 2022] GET /identity/v3/role_assignments?user.id=b5b9b3ac8ed94fc1831476c8d41323b4&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:32.456518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:32.457540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.458023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.458516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.472217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:32.477726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:32.479117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:32.479943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:32.482468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 283/544] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:32.490141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:32.640069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a660f-1859-48f3-b580-91a562186a50 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:32.679290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:32.679972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.680256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.680531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.681238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:32.681544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:32.682921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef576e6-6cb9-43b4-b077-f7bcc878279e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:32.692023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 262/545] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:32.697585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:32.703250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe42b7-a1c3-49ea-96bc-2c2623ba229e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.703541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe42b7-a1c3-49ea-96bc-2c2623ba229e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.703817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe42b7-a1c3-49ea-96bc-2c2623ba229e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.705666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 263/546] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:32.712515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.712688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.712966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.744215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:32.745424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:32.838765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:32.872092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bedb29-0e3e-438e-8c52-1ae3021ba00a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:32.877876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 264/547] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:32.898620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:32.910192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:32.910844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:32.911126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:32.911472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:32.915939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:32.922307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:32.924782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:32.942539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:32.943469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:32.944355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:32.944355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:32.944355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:32.944355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:32.944355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 284/548] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:32.950988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.096221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27c9a7-a165-4b5f-a510-8c78563b9399 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.136350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.137169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.137551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.137978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.151458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:33.156407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:33.157565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:33.158952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:33.161486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 265/549] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:33.171509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.211977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd643-2dd3-45ff-87af-6b05917cf39a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.228663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:33.258804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.259744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.260038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.260318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.261018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:33.261325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:33.263589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeaf3f-ab3c-423e-9cfd-a0c246c812dd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:33.291180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 285/550] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:33.291180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a1f07-9973-4442-bda8-3d51657fab5f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.291180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a1f07-9973-4442-bda8-3d51657fab5f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.291180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a1f07-9973-4442-bda8-3d51657fab5f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.291180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 286/551] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:33.291180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a1f07-9973-4442-bda8-3d51657fab5f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.308563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec1ba1-ff8f-44a0-8f36-9160dfc06e37 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.343004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:33.351112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.351877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.352360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.352859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.353687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:33.354057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:33.355642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66306ddc-0b2b-4424-a3c8-a5d4223bcff7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:33.365932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 266/552] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:33.367503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.367689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.367916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.388581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:33.390783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:33.430387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a1f07-9973-4442-bda8-3d51657fab5f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.474362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 267/553] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:33.475604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.476347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.476995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.477311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.477589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.488457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:33.489914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:33.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:33.508306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:33.509205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 287/554] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:33.509768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.527759 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:33.619355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91910edf-f21c-4db3-9d6a-6238aebf2dd3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.621409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:33.628105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ea83-d183-4244-b584-1533674e50e5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.660651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.661781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.662314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.662760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.664094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.664794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.665136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.665479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.675701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:33.676309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:33.677580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:33.681810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:33.682786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:33.683637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 288/555] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:33.684298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:33.697932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:33.699104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:33.700499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:33.700499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:33.700499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:33.700499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:33.702674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 268/556] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:33.703683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.790696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033a251-303e-4f64-9657-8ff81e462f52 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.807659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:33.819026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9602-d6fa-4fa0-b6bc-e8cd9238cfec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.827801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.828507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.828842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.829685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.830575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:33.830924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:33.832877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:33.852555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 289/557] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:33.853529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.861940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.862816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.863321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.863789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.864683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:33.865159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:33.866721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:33.870307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:33.877237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 269/558] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:33.878365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:33.959950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee39e-385b-41e4-8a37-92932ca0ef46 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.989411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6ee1-e086-4090-90f0-8cce3e4f6694 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:33.996445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:33.997056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:33.997333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:33.997601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:33.998685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:33.998685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.000139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.012571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 290/559] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:34.013412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.030120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fab69-37e5-47aa-b69f-c8d7c3227257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.031046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fab69-37e5-47aa-b69f-c8d7c3227257 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.031586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fab69-37e5-47aa-b69f-c8d7c3227257 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.032082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fab69-37e5-47aa-b69f-c8d7c3227257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.057119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.093274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.111924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fab69-37e5-47aa-b69f-c8d7c3227257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.113698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fab69-37e5-47aa-b69f-c8d7c3227257 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.121023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154720d-96ff-49cd-8a5f-dced7f1f11d2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.156431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.157070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.157890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.159068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.169655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.171107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:34.185660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:34.186550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:34.187475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:34.187475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:34.187475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:34.187475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:34.187475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 291/560] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:34.188445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.229626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 270/561] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:34.231300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc03f9-9f9c-4dba-9d67-ec1d66f87ae7 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.231786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc03f9-9f9c-4dba-9d67-ec1d66f87ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.232356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc03f9-9f9c-4dba-9d67-ec1d66f87ae7 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.237959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 271/562] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:34.237959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc03f9-9f9c-4dba-9d67-ec1d66f87ae7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.299911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.301945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973a68-2bbf-45d1-b03b-b192590a6280 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.328852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.338414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.339056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.339371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.339676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.347904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.349392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.359679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc03f9-9f9c-4dba-9d67-ec1d66f87ae7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:34.361360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:34.362640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 292/563] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:34.363588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.404163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.404806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.405093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.405363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.406047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:34.406348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.408584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c77f27-4b5e-4541-8659-a9aba84e1c56 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.423581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 272/564] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:34.423581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.423581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.423581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.441574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:34.442762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:34.478885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe73db-bbde-4b2b-a804-09a5eeb1e442 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.523262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 273/565] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:34.523262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.524407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.525165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.525443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.525713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.537507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.539138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:34.555313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:34.556227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:34.557119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:34.557119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:34.557119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:34.557119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:34.557119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 293/566] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:34.557398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.577563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.601448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.640957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a884223-21b4-4f20-88de-615d2e3b9c92 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.669329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ffef7-2446-43cc-942b-6c72cfbf559e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.677369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.678214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.678498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.678774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.679735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:34.680042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.681480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.700638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 274/567] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:34.705649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.706986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.707663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.707947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.708402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.717160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.718604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:34.730706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:34.731949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:34.732904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 294/568] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:34.733486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.804734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.807968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd73fa3-123b-42d9-808a-5c3b7232b7f5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.829078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:34.833633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7109889-5940-49db-95b5-daf93a52173e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.848718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.849346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.849626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.849893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.860023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:34.865592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:34.866562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:34.867450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 275/569] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:34.868127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.873155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:34.873765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.874047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.874318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.874997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:34.875330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:34.877905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5659c1-a69f-402f-946f-3b519303d7d2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:34.889575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 295/570] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:34.890741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5df96-c462-41c5-a34e-6d886ef39347 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:34.891024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5df96-c462-41c5-a34e-6d886ef39347 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:34.891325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5df96-c462-41c5-a34e-6d886ef39347 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:34.893169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 296/571] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:34.893871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5df96-c462-41c5-a34e-6d886ef39347 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:34.976058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edee7-9f4c-4244-a19f-6bf767d16c9b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:34.994007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5df96-c462-41c5-a34e-6d886ef39347 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.009668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.010301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.010580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.010850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.022021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.023524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.027943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.028546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.028821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.029086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.029855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.030153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.031581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:35.038440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:35.039624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:35.040573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:35.040573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:35.040573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:35.040573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:35.040573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 276/572] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:35.040906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.050075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 297/573] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 05:03:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.050866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.059192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.071729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.143246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f23c-55bb-4286-a09c-7b5183272cc7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.150561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89fc6-1e1f-4b53-8453-89a0478cc997 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.177913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.178522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.178799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.179070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.179796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.180094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.181437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de600f-7749-45e6-b425-568b2fd0cdee None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.185790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.186421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.186701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.186970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.189712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 277/574] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.190846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.191126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.191416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.194441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.195894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:35.208216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:35.209272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:35.210155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:35.210755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:35.211294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:35.211481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 298/575] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:35.212423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.277998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 278/576] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:35.278838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.281901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.300132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.322235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331bf2-df7f-4d6c-a2f1-57f841ba83e2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.356166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.356779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.357056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.357327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.358009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.358305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.359704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.375780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 299/577] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.375780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.379086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cf0e-8826-461b-8cf9-f58d0b56adfa None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.413208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.413835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.414112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.414380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.425078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.426567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:35.440939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:35.442003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:35.442912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:35.442912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:35.442912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:35.442912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:35.442912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 279/578] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:35.443372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.476598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c3761-d8c9-4ed1-822d-09d4837180ca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.497783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.509664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.510295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.510573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.510840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.513428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.522018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.523476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:35.538271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:35.539756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:35.540798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:35.540798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:35.540798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:35.540798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:35.543288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 300/579] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:35.544071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22971-f838-4d63-95c8-81d941b52407 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.544259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.577270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.577793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.578411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.578411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.579052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.579954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.581374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.593045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 280/580] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.593805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.645522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931fc64-6764-4151-9b53-9259a370b420 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.678481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.679252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.679626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.679993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.690117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:35.691677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0b980-3aa9-4d10-b6a9-4535afafef99 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:35.695292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:35.696364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 301/581] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:35.697208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.711857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.729565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.730193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.730468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.730736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.740171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.741598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.745301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:35.753565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:35.754612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 281/582] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:35.755870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.799848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89eb6-18ec-4681-9918-0c81f1d739e6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.832563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.833107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.833388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.833664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.834351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.834656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.836121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.848200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 302/583] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.848979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.858188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caf1b-7166-4eb4-a6b5-6ac6454885e4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.893017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.893714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.894068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.894410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.895189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.895557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.897006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.908824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 282/584] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.909684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:35.943137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.947208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280131e7-cf24-40af-8cc6-74006d28acae None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:35.957119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:35.981820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:35.982424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:35.982700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:35.982968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:35.983769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=71f965b370df48a3a79ba0dd8a2ddf1e) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:35.984073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:35.986048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:35.991391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 303/585] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/role_assignments?user.id=71f965b370df48a3a79ba0dd8a2ddf1e&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:35.991954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.025442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0327d-acd1-4830-8d44-bc6a9840caf4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.064890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.065575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.065855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.066127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.066845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:36.067136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.068578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.083581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 283/586] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:36.083581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.118101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a753e5-b21f-4c3d-a30f-474f5bb8f7b6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.157493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.158233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.158578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.158918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.159766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:36.160158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.161656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.180365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 304/587] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:36.185845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.200306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.205021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f903d-6e6e-46aa-869c-e76be1cbe686 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.222121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.242872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.243545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.243819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.244150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.251899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.253331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:36.265413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:36.266508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 284/588] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:36.267669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.310165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b3d49-7086-44cf-b822-4dda906a10d9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.349479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.350122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.350468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.350744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] PATH_INFO: `/v3/users/glance` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.357885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.359335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:36.370889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:36.371969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 305/589] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:36.372959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.382695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf78ba-ec66-4c83-81fc-a1b48f8edd39 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.420435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.421637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.422522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.423778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.434664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.436190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:36.450799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:36.451757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:36.452634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:36.452634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:36.452634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:36.452634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:36.452634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 285/590] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:36.453408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.469268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.476314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.487452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5f81-58fa-48b8-8a84-c6b3226a52be None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.523774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.524493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.524773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.525070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/097e3f30073e48ec832b53d8f89d0d16/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.540694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=097e3f30073e48ec832b53d8f89d0d16, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.542152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.563199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 306/591] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:36 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/097e3f30073e48ec832b53d8f89d0d16/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:36.563199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.572493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209667-7a0d-4e03-9e82-0abda246eabb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.614797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.615443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.615804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.616140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.617081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:36.617558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.619116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.634961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 286/592] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:36.635733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.700697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba12a0-9180-466c-963f-427b7f975b42 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.718276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.741874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.742524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.742770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.743044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.744947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:36.745279 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.746732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.758612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c5c68-ecc3-48a2-b41d-a07e27f11b34 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.764778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.769846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 307/593] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:36.770670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.810191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.811204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.811677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.812189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.813080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:36.814217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.815808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.828440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 287/594] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:36.830148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:36.905397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6079-12fc-496e-a07d-d5de41283b80 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.950116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bdb3-32b7-4fa5-ac43-ebf3d960ce2f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:36.956289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.957225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.957730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.958662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/27ec934145884311899c8ebd19082646/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:36.978424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=27ec934145884311899c8ebd19082646, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:36.980635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:36.983721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:36.987905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:36.988705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:36.989150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:36.989821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.007895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 308/595] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:36 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/27ec934145884311899c8ebd19082646/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:37.009517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.010224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.011877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:37.042499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:37.043488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:37.044366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:37.044366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:37.044366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:37.044366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:37.050114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 288/596] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:37.051377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.104885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:37.168935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878901e8-ab64-4f43-aa67-795ae82f0fc5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.218166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.219473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.220973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.221747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.231504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.233375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.241467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7589-0cb5-43d9-83c3-ecc8294af950 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:37.247222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:37.248142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 05:03:37.249110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:37.252029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 309/597] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:37.258210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.278040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.278657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.278939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.279246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.280040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:37.280347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.281820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.299307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 289/598] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:37.305555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.354371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:37.374180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda639d2-cfb1-4bde-83fc-243e51dfdcf2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.386027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:37.412611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.413684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.414172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.414667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.415804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:37.416363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.418003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.418813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31204f18-d2ca-4379-bf0e-784dbea72448 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.438060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 310/599] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:37.443991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.456882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.457528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.457809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.458078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.465934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.467562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:37.480887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:37.481823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:37.482706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 290/600] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:37.489809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.629366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e8c0-b2a7-4ab0-a778-86fea3157934 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.637087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36628e81-d3cd-443b-a774-8bbc89fd2ec7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.650845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:37.673785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.674489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.674770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.675042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.675813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:37.676119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.677708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.691666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 291/601] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:37.698145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.715395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.716035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.716311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.716592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.736940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.738400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:37.776342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:37.777307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:37.778225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:37.778225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:37.778225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:37.778225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:37.778225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 311/602] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:37.788131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:37.809657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb151c9-27dc-4811-b5e4-171b0433e4b7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:37.846199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:37.846942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:37.847261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:37.847538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/b35db16684ea4a4d9c6743bd3c094439/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:37.858212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:37.865176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=b35db16684ea4a4d9c6743bd3c094439, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:37.866888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:37.913788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 292/603] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:37 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/b35db16684ea4a4d9c6743bd3c094439/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:37.994362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f5a3-6abe-40eb-86e7-5d905e4d14ca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:38.049445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:38.055319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.055747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.056120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.056943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:38.057351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:38.058835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0429b-9b51-401e-9eee-30ce4032736f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:38.091760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 312/604] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:38.100302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:38.132210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:38.221857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c01c5e-6320-4602-991f-79ceaac0fb81 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.222176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c01c5e-6320-4602-991f-79ceaac0fb81 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.222430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c01c5e-6320-4602-991f-79ceaac0fb81 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.224432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 313/605] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:38.231108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.231410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.231673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.257724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:38.259142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:38.262997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfc65-4b33-43fc-a8b4-be8ab674926a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:38.306520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:38.307195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.307489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.307766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.316338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:38.318405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:38.333366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:38.334334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:38.335879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 293/606] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:38.341102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:38.348737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 314/607] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:38.377243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:38.395497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:38.507583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:38.528851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db26e6-832c-433d-9fa4-23333b2a7367 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:38.599242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:38.599872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.600152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.600430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.601174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:38.601479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:38.602919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:38.607342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d069f-362c-453f-88b2-81b73cc70f09 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:38.641793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 294/608] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:38.643434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:38.677262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:38.677909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.678182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.678457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.707765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:38.713186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:38.714130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:38.714996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:38.720286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 315/609] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:38.733657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:38.776241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730575e-df9e-4a05-9798-3916a395535c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:38.811613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:38.815842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfe5db-93e9-4f25-8350-f2464ff4d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:38.816451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe5db-93e9-4f25-8350-f2464ff4d0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.816741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe5db-93e9-4f25-8350-f2464ff4d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.817388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe5db-93e9-4f25-8350-f2464ff4d0a7 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/b5b9b3ac8ed94fc1831476c8d41323b4/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.834188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfe5db-93e9-4f25-8350-f2464ff4d0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=b5b9b3ac8ed94fc1831476c8d41323b4, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:38.835910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfe5db-93e9-4f25-8350-f2464ff4d0a7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:38.853278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 295/610] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:38 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/b5b9b3ac8ed94fc1831476c8d41323b4/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:03:38.854935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7aa45-6094-4b10-9a0f-6f785131b397 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.856269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7aa45-6094-4b10-9a0f-6f785131b397 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.856551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7aa45-6094-4b10-9a0f-6f785131b397 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.858197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 296/611] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:38.870399 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:38.872760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:38.873073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:38.914844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:38.918743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:38.947114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.026167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811bc71-c33a-4051-9a75-f86cefa03d84 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.051658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 297/612] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:39.068737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.069298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.069580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.069918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.070644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:39.070956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:39.071071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.072367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:39.085028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 316/613] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:39.091462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.189693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0b496-42f4-4f03-9987-28e105ed9920 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.204587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.243182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076040-915a-42cd-abc8-d3922d0e37f7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.246474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.247118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.247423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.248680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.266112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:39.272621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:39.273558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:39.274377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 298/614] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:39.279725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.305141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.305790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.306073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.306350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.308539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.327814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:39.329736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:39.361025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:39.362970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:39.365058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:39.365058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:39.365058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:39.365058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:39.365058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 317/615] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:39.370087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.483517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d674-3cba-423e-8869-fc196e0339cd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.493603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44111e-9e43-4807-bfb0-08e85fba45fd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.523393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.524351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.524899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.525343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.526716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:39.527187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:39.529142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4acc5-1c5e-4197-82b3-72ee50fcc70a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:39.534778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.535557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.535939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.536326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.537135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:39.537537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:39.539540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df8e94-56fc-4d67-b727-ee0b9fe09c2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:39.544769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 318/616] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:39.546169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d3c0-27b5-4677-82c9-683e51698220 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.547000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d3c0-27b5-4677-82c9-683e51698220 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.547428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d3c0-27b5-4677-82c9-683e51698220 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.553770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 319/617] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:39.554705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d3c0-27b5-4677-82c9-683e51698220 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.555843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 299/618] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:39.557186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.557474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.557750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.575902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:39.577077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:39.605880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.614317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.655195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 300/619] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:39.655195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.691808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d3c0-27b5-4677-82c9-683e51698220 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.726917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.727583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.727863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.728148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.735554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:39.737010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:39.749444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:39.750491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:39.751589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 320/620] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:39.756225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.774542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466960-0e71-4ff1-b0ca-1cd1b2542325 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.810963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.811958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.812433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.812895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.825248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:39.826995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:39.844315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:39.845469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:39.846339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:39.846339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:39.846339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:39.846339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:39.848648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 301/621] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:39.849664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.865237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48d3ab-e080-46e5-8a40-de2e8385d728 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.867583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.871143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:39.911277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:39.911925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:39.912209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:39.912534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:39.924548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:39.930037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:39.930954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:39.931821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:39.935422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 321/622] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:39.936260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:39.964262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd875cb-0141-415f-80e4-3df6bfd7a47c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:39.999594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.000602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.001137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.001603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.002570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:40.003066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.004698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.023260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 302/623] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:40.024397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.050007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5f364-56da-4176-ab1a-250f069a60ac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.087572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.088247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.088567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.088837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.089537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:40.089886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.091305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.101974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.105288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 322/624] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:40.106299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.129155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543953b-a3e0-468a-a436-b05890d30b12 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.134707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.169190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.170422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.173073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.173344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.174083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:40.174382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.176026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.189342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 303/625] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:40.189342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.234843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625181-d6d6-4b1b-838e-00a9a3f9eca4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.274251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.275328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.275818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.276320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.289596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.291712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.293841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8b1c1-6e74-477e-8c07-515e305431d6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:40.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:40.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:40.310879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:40.310879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:40.310879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:40.310879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:40.313165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 323/626] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:40.314608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.329341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.329944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.330222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.330490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.333260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.339011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.340512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:40.355464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:40.356471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:40.357514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 304/627] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:40.358101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.405007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.433291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99870043-cd3a-489c-b0d9-9e80e2e00aa8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.466092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.466715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.466988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.467175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fe40-d6de-4812-8387-a88ab573c486 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.467305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.480278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.481943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4ec82dbf-5759-492c-960d-15fd3a902987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:40.497178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:40.498087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:40.499030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:40.499030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:40.499030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:40.499030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:40.502982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 324/628] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:40.504127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b8733-63dc-4ce4-92e6-3dded2110ee4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.504418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b8733-63dc-4ce4-92e6-3dded2110ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.504696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b8733-63dc-4ce4-92e6-3dded2110ee4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.505224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.505828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.510205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.510326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 325/629] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:40.510406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.510494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b8733-63dc-4ce4-92e6-3dded2110ee4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.510586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:40.510586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.510586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.521575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 305/630] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:40.522364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.583632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.627560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b8733-63dc-4ce4-92e6-3dded2110ee4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.640744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee02a-3136-44a5-b2f1-8f0e8083142e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.654594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.662887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.663459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.663830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.664004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.664781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:40.665084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.666509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63ebc-5d18-4863-bcd8-dc2bd2cd7d37 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.678652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.679289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.679567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.679833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.680512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:40.680808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.682142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.689677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 326/631] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:40.689677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.689677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.689677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.695817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 306/632] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:40.696599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.710935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:40.712186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:40.784533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 327/633] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:40.786271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.821133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce63a-06ae-43f8-9cb1-6d2c8b4e1a64 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.842510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.864792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.865443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.865725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.865999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:40.873187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:40.874635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:40.886431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:40.887416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:40.888292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 307/634] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:40.888781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:40.898572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222feb47-e0c7-4db3-844f-d7c1fcf12691 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:40.917925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:40.938995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:40.939641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:40.939926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:40.940202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.005456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115c12-2b7f-41a0-9f39-c2707969ded2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.009421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.010878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.044270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.044602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.044816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.045098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.054014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.055804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:41.068446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:41.069428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 308/635] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:41.070350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.109761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.116606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 328/636] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:41.117326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.134559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.195192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34b09-adee-4a4b-8f99-a952a0085cd9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.227323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83147eec-6781-4d12-8a32-7a0b6cb69fac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.228612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.229230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.229511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.229781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.240611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:41.246536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:41.247778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:41.248637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 309/637] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:41.249334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.263895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.264516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.264795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.265065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.265813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:41.266116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.268120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.279282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 329/638] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:41.280116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.346937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.353947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0e6-b443-41bc-afec-cb02ec5c762d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.360127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.385398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b7c75-39fb-425a-ae91-5e3b823d0369 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.388167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.388774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.389054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.389325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.390105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:41.390410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.392160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f700e-e481-462e-a7d0-143fa2f1d6e4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.409069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 310/639] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:41.410307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143fd92-9821-4c3d-95a7-92777c0d16cd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.410596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143fd92-9821-4c3d-95a7-92777c0d16cd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.410875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143fd92-9821-4c3d-95a7-92777c0d16cd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.415397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 311/640] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:41.415397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143fd92-9821-4c3d-95a7-92777c0d16cd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.424763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.425446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.425821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.426276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.437850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.440571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:41.454864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:41.456019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:41.456958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:41.456958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:41.456958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:41.456958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:41.456958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 330/641] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:41.457245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.520639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143fd92-9821-4c3d-95a7-92777c0d16cd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.555114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.555743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.556021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.556291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.556801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b33904-d94c-4578-b08e-1384b491122f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.556989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:41.557289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.558639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.567205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 312/642] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:41.568217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.585821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.587758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.596520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4675a-a573-49b9-96a7-500d1b871f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.597185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4675a-a573-49b9-96a7-500d1b871f25 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.597455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4675a-a573-49b9-96a7-500d1b871f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.597737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4675a-a573-49b9-96a7-500d1b871f25 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/71f965b370df48a3a79ba0dd8a2ddf1e/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.612526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4675a-a573-49b9-96a7-500d1b871f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=71f965b370df48a3a79ba0dd8a2ddf1e, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.613993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4675a-a573-49b9-96a7-500d1b871f25 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.625483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 331/643] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:41 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/71f965b370df48a3a79ba0dd8a2ddf1e/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:41.627250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.627536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.627809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.646456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:41.647707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:41.682179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76740ef8-2c6e-4b33-bdff-2bc3cb5ae095 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.720705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.721339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.721617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.721888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.736152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 332/644] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:41.736152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.816369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.818617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.838076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.847084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024272c-39da-49e6-b11c-e89e4339aba4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:41.856519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:41.882974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:41.883621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:41.883900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:41.884168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:41.884848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:41.885146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:41.886509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:41.898362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 333/645] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:41.899182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:41.939227 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 313/646] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:41.940325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.009109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa746b5-3656-4275-b3b2-5604b06793a1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.046686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.047500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.047706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.047960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.054058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0035-958a-455e-a356-4a79ab563535 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.058501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.059957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.074462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:42.075186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:42.076336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:42.082993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:42.082993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:42.082993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:42.082993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:42.082993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 334/647] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:42.082993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.101325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.101962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.102243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.102515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.105411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.114007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:42.119651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:42.120628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:42.121473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:42.125684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 314/648] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:42.126837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.199080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97cb5-3fa2-44be-bc05-8c2102c36012 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.238210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa55084-6615-4193-9a72-0d55a57cf139 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.240384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.241039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.241316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.241585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.248598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.250041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:42.262140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:42.263380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 335/649] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:42.264648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.282688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.283396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.283649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.283924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.294796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.296276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:42.312363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:42.313562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:42.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:42.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:42.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:42.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:42.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 315/650] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:42.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.349048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.359489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.380947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbd80-e5cb-49d4-861a-bed4008f7111 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.417190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.417888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.418231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.418571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.419349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:42.419707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.421141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.428078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331d94c-7a4e-4c78-a643-777133e8ebde None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.436690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 336/651] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:42.436690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.470265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.470820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.471327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.471752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.472440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:42.472745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.475202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.490192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 316/652] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:42.490192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.542959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a9e2-565f-42dd-92a3-f7ff90c0f9b0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.581581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.582466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.582886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.583323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.584499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:42.584959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.587185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.589891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.600694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.601495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0615276-c148-4b46-af8c-2c4981e2ca7c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.609346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 337/653] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:42.610223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.640670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.642226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.642713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.643197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.644072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:42.644614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.646286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.659950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 317/654] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:42.661158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.720112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49900-94dd-43c2-bfe1-fe48456632d9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.757469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.758092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.758298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.758571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.767224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.768663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.778679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac571b-78b8-4dd4-acc2-6a4ef244a964 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:42.779804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:42.780721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 05:03:42.781693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:42.785492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 338/655] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:42.786273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.819367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.820000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.820278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.820547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.831559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.833007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.847859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:42.851353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:42.852312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:42.853215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:42.853215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:42.853215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:42.853215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:42.857180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 318/656] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:42.858021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.861786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:42.893873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda93d6c-7b94-4813-880f-6c509fa3d658 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:42.932490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:42.933104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:42.933384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:42.933658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:42.934435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=097e3f30073e48ec832b53d8f89d0d16) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:42.934745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:42.936226 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:42.942451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 339/657] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/role_assignments?user.id=097e3f30073e48ec832b53d8f89d0d16&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:42.943251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:42.990163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cb7ab-eff5-4562-b8bd-46d8ab8ba631 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.038263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.039852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.040129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.040397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.054472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.056140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:43.069890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:43.070872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 319/658] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:43.072370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.082037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2e0d-0084-448d-9e11-229df83faea5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.112514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:43.127793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.129193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.129193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.129365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.130105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:43.130409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.132152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.150635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 340/659] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 05:03:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:43.151197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.171615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:43.226699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe62c-378b-4b93-8b22-490da0943f7e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.268262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.269141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.269522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.269895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.270873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:43.271306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.273499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.289868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 320/660] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:43.291085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.299888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6d83a-c10a-42f6-bdcc-4f872c07d0c2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.337416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.338415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.338943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.339457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.340393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:43.340940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.342630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.358795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 341/661] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:43.361323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.419892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c72253-87ec-4819-8b8e-32b86f4222ee None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.425101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:43.446864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:43.460790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.461848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.462428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.462892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.505574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14bf6-796b-4048-8604-c00137fd7287 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.542507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.544415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.551579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.552280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.552570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.552842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.563617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.565845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:43.582701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:43.583746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 05:03:43.584697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:43.587251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 342/662] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:43.588242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.665039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 321/663] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:43.666326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.693683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:43.705066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1816c8-6bdf-4115-8b7f-5b16ce99ae80 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.706593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:43.740586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.741351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.741754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.742133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.743013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=27ec934145884311899c8ebd19082646) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:43.743457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.744891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6afcf-051a-41ef-9d13-86e5b4f63fca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 343/664] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/role_assignments?user.id=27ec934145884311899c8ebd19082646&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:43.753645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a354-1332-47f1-b301-4bbde2b9a029 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.753928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a354-1332-47f1-b301-4bbde2b9a029 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.754201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a354-1332-47f1-b301-4bbde2b9a029 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.759816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 344/665] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:43.760764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a354-1332-47f1-b301-4bbde2b9a029 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:43.799714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548cd4-ed55-4eef-bcad-5851afee1ce0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.853241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.854137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.854738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.855216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.856812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:43.857371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.859518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6417a2a-6a47-4c50-b442-fdbe17eae922 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.890553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 322/666] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:43.890553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.890553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.890553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.891790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a354-1332-47f1-b301-4bbde2b9a029 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:43.918746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:43.920531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:43.934776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:43.935567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:43.935958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:43.936316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:43.951129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:43.953021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:43.968949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:43.971390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:43.972592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:43.972592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:43.972592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:43.972592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:43.972592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 345/667] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:43.973000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.002375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.006049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 323/668] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:44.006990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.023488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.113328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861bafe-5061-4264-8306-35cd0abc9a8d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.114553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d47e-7107-49a1-804d-cdba59999666 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.156425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.157863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.158483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.158483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.159066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:44.159402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.160942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.166826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.167497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.168878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.169174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.180449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 324/669] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:44.181353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.254420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.270282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.271926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.290831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.298927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a44710-207c-4c83-8e68-ceed58eb4164 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.345995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.347013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.351474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.352446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.367514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:44.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:44.376641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:44.377698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:44.380225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 325/670] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:44.383442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.387996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 346/671] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:44.388242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.500080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb64419-2a81-43b9-9838-5d88de0bc59a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.521699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.526337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56065-bded-4553-b191-6fc9833e8a9d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.546920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.548604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.549330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.549790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.550953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:44.551840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.554032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.556750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.563422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.564404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.564878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.565451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.568074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 347/672] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:44.569424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.574247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.575317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:44.589501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:44.590641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:44.591769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:44.593475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 326/673] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:44.594541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.702853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a156f8-96d4-4953-8d58-a882c1cc7e20 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.709733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa656349-0b76-4111-a6fa-b98932f18ed1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.746910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.747719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.748083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.748601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.757470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.758351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.759278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.759724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.761168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.762703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.773759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.775775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:44.778593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:44.779758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:44.780943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:44.780943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:44.780943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:44.780943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:44.782774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 327/674] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:44.784068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:44.797017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:44.798286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:44.799500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:44.799500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:44.799500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:44.799500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:44.801483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 348/675] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:44.802379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.838799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.845273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:44.901035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693d77-a81a-4418-98fa-c623883416cb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.939111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.939919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.940159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189abab-1f65-4149-ad8e-a72ee7db0f50 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:44.940410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.940774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.941611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:44.942008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.944045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:44.957822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 328/676] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:44.958836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:44.982288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:44.983026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:44.983692 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:44.983910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:44.984687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:44.985691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:44.987345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.000311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 349/677] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:45.001599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.081663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7901d-1fbc-4d2e-9f53-3862cb17c66b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.083854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:45.121270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.121895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.122173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.122440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.123130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:45.123457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.124805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.142826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 329/678] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:45.142826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.223242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:45.232825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090271-a7a4-4db7-a334-dc936cadbd00 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.254550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71842-1bc8-4e80-818c-7f9d54609bfb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.268510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.269118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.269393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.269659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.270426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=b35db16684ea4a4d9c6743bd3c094439) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:45.270727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.272193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de2e3-0098-4310-a939-09735c985fb2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.278061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 350/679] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/role_assignments?user.id=b35db16684ea4a4d9c6743bd3c094439&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:45.279280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49254-eb6d-4754-991f-daefc003d846 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.279560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49254-eb6d-4754-991f-daefc003d846 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.279827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49254-eb6d-4754-991f-daefc003d846 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.283252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 351/680] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:45.283252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f49254-eb6d-4754-991f-daefc003d846 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.303137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.303926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.304330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.304678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.317592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.320298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-87df6f77-91b2-4b55-b315-b4737df2ed8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:45.338412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:45.339939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:45.341386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:45.342391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 330/681] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:45.342840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.343127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.343430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.369546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:45.371042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:45.397627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:45.418763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f49254-eb6d-4754-991f-daefc003d846 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.458766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.459460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.459738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.460012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.467067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 331/682] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:45.468366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.471873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.473686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:45.488375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:45.489318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:45.490190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:45.492440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 352/683] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:45.493447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.520694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:45.596714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f7289-58c0-4da8-8c4f-264e9425791d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.622248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa0d-fa7d-4891-b6fb-efc1bce7634e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.644509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.645814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.646303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.646777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.647890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:45.648407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.650031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.661816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.662519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.662804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.663075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.671548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 332/684] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:45.673460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.674613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:45.679667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:45.680898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 353/685] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:45.682412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.692809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:45.778402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:45.800468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756632e-e237-496d-9434-3af75fc1d78d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.808845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbf4d0-fb5e-471e-bf0e-f2f452afa89c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:45.846437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.847034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.847347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.847617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.852605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:45.853798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:45.854280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:45.854770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:45.855743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:45.856769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.858394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.876773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 333/686] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:45.877972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:45.928016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:45.929492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:45.979551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.017123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb0f44-4f54-44f0-aa33-4bdcc1b8e5a8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.024885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.051220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 354/687] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:46.051997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.057162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.057792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.058075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.058352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.059061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:46.059396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.060755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54704242-4dc4-4f38-b47e-849c4b3bda1d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.071193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 334/688] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:46.071438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75ea53-08a8-4c08-b64a-e946eea235d6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.071708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75ea53-08a8-4c08-b64a-e946eea235d6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.071984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75ea53-08a8-4c08-b64a-e946eea235d6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.073319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 335/689] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:46.076282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75ea53-08a8-4c08-b64a-e946eea235d6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.162557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ae03-e167-452d-9daa-bc04ce797b97 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.193500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75ea53-08a8-4c08-b64a-e946eea235d6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.200568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.201187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.201464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.201736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.202522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=b5b9b3ac8ed94fc1831476c8d41323b4) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:46.202830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.204477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.211073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 355/690] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/role_assignments?user.id=b5b9b3ac8ed94fc1831476c8d41323b4&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:46.211644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.246002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.254864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.256364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.257106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.257595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.272127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.281728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.285083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e9a7ca19-15e6-44d3-bc9d-a3d5989daed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:46.313067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:46.314511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:46.315461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:46.315461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:46.315461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:46.315461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:46.318708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 336/691] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:46.320933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.323085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.324872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.349402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:46.350871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:46.353529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6fa2-032c-4c30-a896-1cbfcae4073f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.397223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.398125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.398556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.399050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.412068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.413788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:46.433733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:46.434709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:46.435654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:46.435654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:46.435654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:46.435654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:46.435654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 356/692] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:46.436493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.439236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 337/693] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:46.441536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.542342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.555974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f23a35-3961-4829-8c49-4c700805eaa6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.579494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb4791-ae42-4276-85b3-6993d265a9c7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.600916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.603990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.604986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.605754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.606213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.607104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:46.607624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.609752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.625771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 357/694] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:46.626631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.626975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.627820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.628294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.628751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.629724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:46.630342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.631977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.650335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 338/695] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:46.651647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.731920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664a381-2855-4ec8-a536-81a970b6873e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.764608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24c728-1009-418d-bdc3-2e4577d77c72 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.769126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.769849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.770210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.770543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.771250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.772683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:46.783972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:46.785408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:46.786269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 358/696] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:46.787127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.805505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.810018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.810867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.811391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.811840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.820664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.824647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:46.842702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:46.843698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:46.844739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:46.847546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 339/697] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:46.848802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.894450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa15f-3f97-4187-9513-6b66e25ac4f7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:46.897981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:46.945092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:46.945733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:46.946008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:46.946275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:46.958187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:46.960411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:46.977210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:46.978203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:46.979139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:46.986176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 359/698] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:46.986176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:46.998393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83663a1-cc07-4e01-bb99-6f1791ddc75c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.037857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.038475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.038810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.039184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.039797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:47.040102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.041614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.046839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 340/699] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:47.048589 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.091016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.126263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bd486-7c9e-4a43-8cc3-29e8d6baa9f8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.153380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.159189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafec6-9cbc-44a7-b0a1-d3bfabf1b75d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.179871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.180499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.180780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.181053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.181805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:47.182111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.183604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.196853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 360/700] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:47.197759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.214418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.215604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.216118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.216798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.218150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:47.218707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.221367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.249828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 341/701] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:47.249828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.326130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b88f0-cf87-45f7-8166-f15358d37fd2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.360216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c224bd-56b7-4b03-864b-e7133f02b6a9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.372409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.373134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.373450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.373796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.374566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:47.374937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.376677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.380923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.383756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 361/702] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:47.384863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.409494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.411045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.411852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.412321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.413534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=71f965b370df48a3a79ba0dd8a2ddf1e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:47.414048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.416499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1478-e377-4f92-85b8-e9c891e21b25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.426592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 342/703] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/role_assignments?user.id=71f965b370df48a3a79ba0dd8a2ddf1e&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:47.508106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e56213-5f52-4930-bb40-a07fb3da4af2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.511433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e83c5-e261-42a0-afc9-d88413a819bc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.511757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e83c5-e261-42a0-afc9-d88413a819bc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.511986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e83c5-e261-42a0-afc9-d88413a819bc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.514817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 343/704] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:47.520175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.520468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.520820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.549223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.549871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.550153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.550430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.561212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:47.566385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:47.590653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.642471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.643919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.647500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.653533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 344/705] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:47.680239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.779045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 362/706] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:47.786720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.807893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3215bdb-3b90-480e-bcb6-6fb487bd01d0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.847186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.847570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.847853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.848126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.859441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:47.860957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:47.877062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:47.878091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:47.878982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:47.878982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:47.878982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:47.878982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:47.878982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 345/707] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:47.883966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:47.887602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.931430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:47.935822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24289b0-5925-49b6-beb8-f3e824a64eff None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:47.982801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:47.984401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:47.984688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:47.985027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:47.999097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.001403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.014397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02993f-b210-4175-8f30-17cc4f757169 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:48.021191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:48.022107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:48.023011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:48.023011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:48.023011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:48.023011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:48.023273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 363/708] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:48.027725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:48.067370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.068157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.068447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.069036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.070516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:48.070969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.072571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.088756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 346/709] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:48.096226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:48.158946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ee41-97d3-4853-b530-ec7a848e3d71 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.187667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:48.209005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f171-c676-468d-952c-025486201306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.209898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f171-c676-468d-952c-025486201306 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.210393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f171-c676-468d-952c-025486201306 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.210817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f171-c676-468d-952c-025486201306 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.211680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f171-c676-468d-952c-025486201306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:48.212131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f171-c676-468d-952c-025486201306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.213643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f171-c676-468d-952c-025486201306 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.224013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36fefa-fb33-4b88-9f00-f7bd9c79628d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.237726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 364/710] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:48.246484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f171-c676-468d-952c-025486201306 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:48.273516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:48.287486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.288113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.288395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.288667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.289347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.290842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.335980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 347/711] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:03:48 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:48.415424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f171-c676-468d-952c-025486201306 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.465121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.465684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.465966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.466239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.477052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.478626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a0e2f5d6-ae96-4011-b763-a4563833c2d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:48.491706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:48.492734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:48.494009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 365/712] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:48.498757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:48.648002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8f9f-4ac0-44df-ba1d-6d241e08211d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.648494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8f9f-4ac0-44df-ba1d-6d241e08211d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.648782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8f9f-4ac0-44df-ba1d-6d241e08211d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.650420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 366/713] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:48.650538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa747-e2b1-4d29-bc7a-4ad910ee1757 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.656767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.657069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.657327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.670002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:48.691654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.692291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.692571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.692842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.693603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:48.693906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.695498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.699208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:48.700445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:48.714005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 348/714] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:48.721239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:48.798928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 367/715] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:48.821315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:48.823461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:48.837011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fd752-fc94-475e-a633-8e5de48e017d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.878717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.879368 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.879652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.879928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.880716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=097e3f30073e48ec832b53d8f89d0d16) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:48.881026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.882572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.889128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 349/716] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:48 2022] GET /identity/v3/role_assignments?user.id=097e3f30073e48ec832b53d8f89d0d16&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:48.935047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82343c1-8917-4a4c-8c9e-05056df529b8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:48.978873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:48.979491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:48.979773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:48.980050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:48.980691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:48.982103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:48.993521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:48.996022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:48.997985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 368/717] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:48 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:49.004283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:49.076273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:49.138973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ebca9-3d0d-44d5-a240-4b8afcf5fff2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:49.174598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:49.175050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:49.175368 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:49.175651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:49.176331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:49.176642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:49.178022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bc47b-227d-4fe2-ae12-980d1c25e4c3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:49.183051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 350/718] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:03:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:49.189015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:49.279061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:49.329606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958f22-3d8d-4c9a-8a83-0a837bb9b7f4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:49.383402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:49.384027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:49.384312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:49.384583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:49.385258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:49.385560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:49.386930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4301-43a6-446d-bf6f-c50daabdbc2a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:49.395393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 369/719] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:03:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:49.786035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8c4b5-e1c4-4c0b-85aa-9b57fee53f4a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:49.786412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8c4b5-e1c4-4c0b-85aa-9b57fee53f4a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:49.786581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8c4b5-e1c4-4c0b-85aa-9b57fee53f4a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:49.788268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 351/720] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:49.793578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80d212-99e1-4400-921f-8c3eab76ca2e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:49.793867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80d212-99e1-4400-921f-8c3eab76ca2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:49.794201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80d212-99e1-4400-921f-8c3eab76ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:49.820241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7c80d212-99e1-4400-921f-8c3eab76ca2e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:49.821446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7c80d212-99e1-4400-921f-8c3eab76ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:49.907478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 370/721] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:49.942029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8c4b5-e1c4-4c0b-85aa-9b57fee53f4a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:50.068918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8c4b5-e1c4-4c0b-85aa-9b57fee53f4a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:50.077198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:50.117495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5204bd-6a9d-4de5-9b4e-f1a963d00277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:50.118122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5204bd-6a9d-4de5-9b4e-f1a963d00277 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:50.118406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5204bd-6a9d-4de5-9b4e-f1a963d00277 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:50.118681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5204bd-6a9d-4de5-9b4e-f1a963d00277 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:50.119414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5204bd-6a9d-4de5-9b4e-f1a963d00277 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:50.120788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5204bd-6a9d-4de5-9b4e-f1a963d00277 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:50.150300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 352/722] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:03:49 2022] POST /identity/v3/services => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:50.339028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21fd81-f65d-4516-b514-6d926ef1aab1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:50.339430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21fd81-f65d-4516-b514-6d926ef1aab1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:50.339623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21fd81-f65d-4516-b514-6d926ef1aab1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:50.341202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 371/723] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:50.350483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:50.350782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:50.351039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:50.372313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:50.373509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:50.468249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 353/724] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:50.493117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21fd81-f65d-4516-b514-6d926ef1aab1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:50.560116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:50.611918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21fd81-f65d-4516-b514-6d926ef1aab1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:50.659523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:50.660170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:50.660453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:50.660727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:50.678784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:50.683735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:50.684679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:50.685516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 372/725] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:50.691637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:50.965686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:50.976742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68f778-b781-435c-bb48-e9eda9cabf08 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.024931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.025557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.025831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.026104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.026816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:51.027114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:51.028508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f2e7-ec0c-41f7-bbbd-4dd27fb57dec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:51.039501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 354/726] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:51.044983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.237387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f8ce8-e61c-4b91-812b-9be6dcb7e46a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.256542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9829c3f-8df6-4443-8008-822dd6f4115d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.257057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9829c3f-8df6-4443-8008-822dd6f4115d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.257057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9829c3f-8df6-4443-8008-822dd6f4115d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.258506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 355/727] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:51.263610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c992-0d76-4c26-9ba3-8364b8a68025 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.264111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c992-0d76-4c26-9ba3-8364b8a68025 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.264599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c992-0d76-4c26-9ba3-8364b8a68025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.268422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:51.284554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5f40c992-0d76-4c26-9ba3-8364b8a68025 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:51.286548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5f40c992-0d76-4c26-9ba3-8364b8a68025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:51.299898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.300549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.300828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.301101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.319744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:51.321215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:51.348528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:51.349475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:51.350362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:51.350362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:51.350362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:51.350362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:51.357666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 373/728] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:51.364752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.405273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 356/729] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 05:03:51.407054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd783a2-05ee-47e8-ab68-aedf2fdd7aab None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.407525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd783a2-05ee-47e8-ab68-aedf2fdd7aab None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.407803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd783a2-05ee-47e8-ab68-aedf2fdd7aab None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.409325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 357/730] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:51.423808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.424107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.424354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.444496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:51.445820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:51.503791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f32d-4cd9-4c4b-a533-397efea4a875 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.519271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 358/731] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:51.520130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.536661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:51.562551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.563799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.564071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.564439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.565024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:51.565322 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:51.566690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:51.583492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 374/732] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:03:51.584457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.621120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:51.631466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57771d04-4cbd-4eac-b447-b85bd5c67c17 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.669079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.670102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.670601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.671020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.682828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:51.688697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:51.689825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:51.690855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:51.692118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58da278-28d5-4e15-8175-87c31b32a190 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.693363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 359/733] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:51.694265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.732537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.733146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.733422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.733687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.744912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:51.750003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:51.751394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 375/734] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:51.752424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.782632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:51.811332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c208-5a5c-4c72-9a97-eb4287c8ca80 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.849628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.850071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.850414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.850693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.858510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:51.860622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:51.861408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:51.870719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ba7e-921f-4c34-b0e6-2ef11b865c5a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:51.875812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:51.876981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:51.878131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:51.880464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 360/735] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:51.881478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.911847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:51.912563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:51.912850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:51.913124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:51.913930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:51.914217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:51.915606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:51.929250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 376/736] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:51.930115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:51.993574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3897-13c5-46b8-93a7-9ade2c580885 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.027741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.028350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.028633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.028915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.029609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:52.029912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.031298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.033352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.036971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87c6e-f7a8-49af-b141-3659f637f8ca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.042158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 361/737] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:52.042956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.080715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.081353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.081637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.081897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.082687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:52.082991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.084462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1558b0-39e6-4566-af83-05a0ceb9337d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.103569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 377/738] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 05:03:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:52.108300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b75c-46fe-4401-bd2e-d0275a8d15f0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.108300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b75c-46fe-4401-bd2e-d0275a8d15f0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.108300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b75c-46fe-4401-bd2e-d0275a8d15f0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.108300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 378/739] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:52.108300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653b75c-46fe-4401-bd2e-d0275a8d15f0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.124905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.161655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f584-d641-4d10-8ab0-47be2d805dbf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.203307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.203976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.204250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.204521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.214926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.216400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.223425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653b75c-46fe-4401-bd2e-d0275a8d15f0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:52.232075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:52.233007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:52.233906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:52.233906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:52.233906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:52.233906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:52.233906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 362/740] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:52.236105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.265380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.266131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.266743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.266743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.277043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.278473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.290286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-80b0a143-0004-4495-ab27-1121f87f2157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:52.293791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:52.294763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:52.295704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:52.295704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:52.295704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:52.295704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:52.295704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 379/741] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:52.296820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.296820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.296820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.315412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:52.316606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:52.354602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389c30-8f73-41ff-8ccc-02e49e0461c7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.372785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.382568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 380/742] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 05:03:52.383203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.402094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.403096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.403612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.404171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.478359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.479844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.491719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f3e1-45bd-4663-966a-3211e5fbcc06 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.525539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.526153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.526431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.526696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.527406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:52.527976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.529167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.539184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.545461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 381/743] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:52.545461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.600080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 363/744] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 05:03:52.601220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.604931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.654543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c5feb-864f-4377-b826-1b6f328ee3c0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.689119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.689731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.690005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.690275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.690950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:52.691278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.692640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.704130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52cbc-13b2-45d8-bd73-0dcfb8672cad None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.705142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 382/745] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:52.705933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.743244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.743858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.744137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.744408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.745092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.746437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.760357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 364/746] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:03:52 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:52.761144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.786447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.815303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7fde-421f-467f-a6e2-1e0028aa192d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.833328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:52.861906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.862564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.862841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.863109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.871867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.873487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6a878a7a-c9e3-4c66-967b-a41ac64312e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:52.886823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:52.887926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:52.889445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 383/747] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:52.890048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c8ff5-3a51-49b8-8c18-8cbfe90d6c12 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.890048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c8ff5-3a51-49b8-8c18-8cbfe90d6c12 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.890170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c8ff5-3a51-49b8-8c18-8cbfe90d6c12 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.892513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 384/748] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:52.893045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c8ff5-3a51-49b8-8c18-8cbfe90d6c12 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:52.904853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d6f8-067b-4935-adab-44601c19ef2f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:52.951750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:52.952390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:52.952661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:52.952926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:52.966417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:52.968461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:52.986487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:52.987624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:52.988524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:52.988524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:52.988524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:52.988524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:52.988524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 365/749] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:52.989175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.022256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c8ff5-3a51-49b8-8c18-8cbfe90d6c12 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.051166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.059879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.061266 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.062013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.062500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.072216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.074289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-332c5c77-b796-49b8-8549-0f1e7e948cc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:53.086865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:53.088299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 385/750] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:53.089235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.089884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.089884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.103607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305f7d8-75c5-46a2-954d-8ff51d2e83fd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.107991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:53.109171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:53.133346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.140781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.142016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.142319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.142560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.143372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:53.143677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.145411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.169580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 366/751] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 05:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:53.170347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.185488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 386/752] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:03:53.192394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.283931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045dea8-17aa-46c7-a320-15b9c9391dc2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.303343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac9383-6570-4b9b-a844-7aae91a8b288 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.304647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.329125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.329801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.330094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.330364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.331616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:53.331925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.333720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.337986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.338604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.338883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.339182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.339964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:53.340268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.341700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.350961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 367/753] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:53.350961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.360654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 387/754] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:53.365242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.382799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.468165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689c09-0e14-4c48-9fc0-0ab838883f7d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.469892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0f08-9591-4191-badc-c452b8373932 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.506145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.506756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.507048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.507329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.508958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.509594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.509881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.510131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.510751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.512162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:53.521258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:53.522204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:53.523041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 388/755] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:53.523934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.562293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.586188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.588100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.611363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.631351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc71a-0cc4-4881-8979-fe108709bffb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.666058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.666699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.666977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.667285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.674967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.676455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:53.688650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:53.689566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:53.690479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 389/756] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:53.690980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.712916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 368/757] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:03:53.713799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.801044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2e358-2336-4113-9301-e94ee35b5971 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.804390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.828666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23b5e-93f2-47ff-9126-2c09d9333209 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.835640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.836333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.836556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.836823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.848330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.849790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.851576 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:53.867201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:53.868303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:53.874136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:53.874136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:53.874136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:53.874136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:53.874136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 390/758] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:53.874136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.876656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:53.877272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:53.877555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:53.877821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:53.878485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:53.878781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:53.880165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:53.889301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 369/759] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:53.889301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:53.993284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5e94-1d8b-4257-97f3-059e28e34a68 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:53.993707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8b1f-d48f-4369-88bc-b80d9596c346 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.028793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.029422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.029698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.029968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.031372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.032787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.033067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.033646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.034385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.034687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.036132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.040602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.042011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.043751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.051329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 391/760] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.052159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:54.062946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:54.063909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:54.064796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:54.064796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:54.064796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:54.064796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:54.065742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 370/761] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:54.066004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.116174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.162880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fcf94-195d-4097-8d59-9568c7109983 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.176953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158a5c2-e827-4bac-9325-4bca00539da0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.204008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.204916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.205195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.205508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.206188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.206489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.207875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.212338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.213043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.213393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.213736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.214483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.214857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.216246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.220088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 392/762] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.221077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.231599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 371/763] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.231599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.295041 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.331591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651da24-2974-461b-a545-b80a6325ce2d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.343949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a57e-19c3-4c67-a54a-addbf93effea None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.346028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.369768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.370302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.370729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.370837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.371632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=71f965b370df48a3a79ba0dd8a2ddf1e) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.371938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.373362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.391195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 393/764] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/role_assignments?user.id=71f965b370df48a3a79ba0dd8a2ddf1e&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.391195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.394386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.395105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.395491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.395861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.396629 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.397022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.398506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.416639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 372/765] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.416639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.533062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4447-a798-40b5-91ec-97c874349cc4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.539898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10b08-73ee-4469-8816-5f56e69c4033 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.558300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.580467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.581495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.582038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.582600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.585613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.586543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.586834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.587106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.587902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] RBAC: Adding query filter params (interface=public, service_id=64a81b09e0bc429b8490513ae7a5898b, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.588210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.589648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.591827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.593474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.598829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 373/766] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/endpoints?service_id=64a81b09e0bc429b8490513ae7a5898b&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.599836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:54.606476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:54.607615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:54.608541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:54.610810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 394/767] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:54.611904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.664993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.729079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0329b-86a9-4a34-aa93-ba960545a370 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.739488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c94b5-a787-42c6-b4da-ae36c5d71ae7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.773516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.775009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.775530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.776019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.778101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.779199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.779959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.780337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.781091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.782722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.785160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.786648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.789615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 395/768] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.790556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:54.800137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:54.801260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:54.802886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:54.803749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 374/769] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:54.809392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:54.862840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.933470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e836b-9156-4f90-8d4a-a99b90aec37a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.935099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:54.943831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8d6c8-7de9-49cc-af79-e5747d7cf6e6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:54.972575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.973198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.973475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.973742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.974499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.975283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.976419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5042dd5-dcc6-4f3d-8738-60f01feff343 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:54.993675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 396/770] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:54.996751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990965-3221-4b5e-8176-1483a5b0c292 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.996883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:54.996883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:54.996883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.996883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.997568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990965-3221-4b5e-8176-1483a5b0c292 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:54.997804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:54.998160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990965-3221-4b5e-8176-1483a5b0c292 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:54.998272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:54.999941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 397/771] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:55.000125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce841d61-0303-4b6f-a6a6-ec374e90e015 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.001484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990965-3221-4b5e-8176-1483a5b0c292 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:55.015396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 375/772] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:55.020020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.020313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.020588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.044496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:55.046208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:55.126107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990965-3221-4b5e-8176-1483a5b0c292 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:55.133615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 376/773] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:03:55.135135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:55.164101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:55.165294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.165797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.166356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/097e3f30073e48ec832b53d8f89d0d16/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.168893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=097e3f30073e48ec832b53d8f89d0d16, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:55.170659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.174373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:55.191305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 398/774] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:55 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/097e3f30073e48ec832b53d8f89d0d16/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:55.192875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:55.251273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:55.362572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711401e3-c133-490f-b7c1-d42401db8bf5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:55.369845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8dc7-4437-47ef-b5b3-e6b0a42f290d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:55.408691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:55.409844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.410336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.410868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.412233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=a93912065a104431952b02803d7c3c26) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:55.412765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:55.413418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:55.414168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.414546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.414825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.415005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] PATH_INFO: `/v3/services/network` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.415859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:55.417275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.424093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 377/775] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:03:55 2022] GET /identity/v3/role_assignments?user.id=a93912065a104431952b02803d7c3c26&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:55.431207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:55.432270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:55.433124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 399/776] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:55 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:55.435582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:55.548861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:55.555713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da009d-ba53-4b84-92cc-ff333af584d2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:55.594927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:55.595990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.596502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.596974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.597862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] RBAC: Adding query filter params (name=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:55.598372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:55.600105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.606314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 378/777] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:03:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:55.612355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:55.714148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:55.729611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5067a-ad14-4433-a84a-9fd96c059e37 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:55.765339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:55.766521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.766804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.767075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.767834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:55.768142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:55.769747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.775390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 400/778] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:03:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:55.784261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:55.907718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532f69-a34f-4605-bab2-9f704dea1d2d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:55.948418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:55.949291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:55.949573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:55.949846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:55.950650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] RBAC: Adding query filter params (interface=public, service_id=9941d83bcd204d0e81ded30790688506, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:55.950957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:55.952435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4664bb0-ff28-4503-8924-5c8246d03b3a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:55.961867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 379/779] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:03:55 2022] GET /identity/v3/endpoints?service_id=9941d83bcd204d0e81ded30790688506&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:55.967481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:56.089712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f461-bb31-4033-bfab-399af3bf68bd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:56.124107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457b9e-828a-45e2-bde5-62262b9c0742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:56.124743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457b9e-828a-45e2-bde5-62262b9c0742 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:56.125026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457b9e-828a-45e2-bde5-62262b9c0742 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:56.125822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457b9e-828a-45e2-bde5-62262b9c0742 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:56.126478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457b9e-828a-45e2-bde5-62262b9c0742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:56.127875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457b9e-828a-45e2-bde5-62262b9c0742 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:56.133667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 401/780] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:03:55 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:56.734817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e576-a79a-45e2-bc51-d75d94cd904b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:56.748423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e576-a79a-45e2-bc51-d75d94cd904b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:56.748423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e576-a79a-45e2-bc51-d75d94cd904b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:56.748423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 380/781] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:56.748695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:56.748695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:56.748695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:56.768162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:56.769377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:56.779498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:56.858512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 402/782] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:03:56.893160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867e576-a79a-45e2-bc51-d75d94cd904b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:56.940470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:57.045684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867e576-a79a-45e2-bc51-d75d94cd904b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.089097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:57.089735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.090016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.090290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.108042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:57.113489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:57.114483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:57.115411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 381/783] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:57.120930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:57.254137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfe7c9-d8d5-466c-b041-3d0dd8539aaf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.288862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:57.289488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.289769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.290045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.290763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:57.291067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:57.292468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7103ea-f0b8-4385-b975-2fc950277462 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:57.301807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 403/784] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:57.307196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:57.319703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac064a1-ec00-49d3-9f1b-65eb6a804907 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.320021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac064a1-ec00-49d3-9f1b-65eb6a804907 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.320266 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac064a1-ec00-49d3-9f1b-65eb6a804907 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.322011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 404/785] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:03:57.327384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.327873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.328449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.347501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:57.353182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:57.354358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:57.447595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 405/786] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:03:57.472928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:57.483452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:57.504494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ffacd-5048-4625-af64-d73363dc4742 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.573351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:57.574187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.574432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.574755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.591645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:57.593092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d9f71ad1-86d1-4a49-be7a-e8509880f0a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:57.615619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:57.616628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:57.617802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:57.617802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:57.617802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:57.617802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:57.617802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 382/787] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:57.618278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80019c-8e2f-40ee-8240-61771c467249 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.618653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80019c-8e2f-40ee-8240-61771c467249 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.619122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80019c-8e2f-40ee-8240-61771c467249 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.629856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 383/788] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:57.630704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80019c-8e2f-40ee-8240-61771c467249 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:57.645201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb8caf-7269-471f-87bb-687f18a1a331 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.694482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:57.695330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.695731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.696490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.697119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:57.699278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:57.702783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7f80dd1f-3d11-46b3-b6d2-f76ff109451c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:57.713349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:57.715047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 05:03:57.716130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:57.719431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 406/789] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 5 05:03:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:03:57.720889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.721252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.721528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.740062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:57.741050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:57.757502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80019c-8e2f-40ee-8240-61771c467249 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.801165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:57.802238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.802743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.803255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.804145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:57.804691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:57.806302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:57.809108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:57.821250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 384/790] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:57.827264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:57.832204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 407/791] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:03:57.832204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:57.940943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7f9f-b9f6-49f6-a3f8-624a489f6e7f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.972176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:57.975190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2721-aa7c-48ed-97de-100e7bccf111 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:57.979271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:57.980398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:57.980749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:57.981024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:57.989472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:57.991316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:58.003492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:58.004682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:03:58.005708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:58.008812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 408/792] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:58.009886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.025940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.026554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.026828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.027125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.027894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:58.028194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.029535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8c7fd-4024-471c-93e3-b9de3a955e7f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.034488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 385/793] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 05:03:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:58.035829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7372-698d-43d6-af65-1f13772a995c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.036038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7372-698d-43d6-af65-1f13772a995c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.036306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7372-698d-43d6-af65-1f13772a995c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.037733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 386/794] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:58.038423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e7372-698d-43d6-af65-1f13772a995c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.106578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.122930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8fda-d5b1-4bc6-8e22-db14a432e8f3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.150641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e7372-698d-43d6-af65-1f13772a995c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.158392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.159270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.159565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.159822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.170195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:58.175952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:58.176866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:58.177712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 409/795] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:58.178420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.198770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.199409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.199686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.199955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.200729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:58.201178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.202594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408d9d7-6518-4514-ac55-b1c1a7511592 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.227602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 387/796] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:58.227602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.227602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.227602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.230701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.245883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:58.247061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:58.284965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5de0c-303e-4f0f-91e4-12aeb955c3f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.318663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 388/797] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:03:58.319446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.324579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.325439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.325903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.326353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.327253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:58.328945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.331018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.339067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 410/798] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:58.340189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.372250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.431179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a076-885a-4b0e-97d1-88bbfbe2be19 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.462224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3e03f-70f7-400a-8365-3610680f9694 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.468281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.469495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.470022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.470168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.470861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:58.471183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.472555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.479733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.481066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 389/799] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:58.481653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.506672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.507715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.508331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.508769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.524727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.526785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:58.542716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:58.543793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:58.544851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:58.544851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:58.544851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:58.544851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:58.546298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 411/800] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:58.548267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.593966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e4eb0-bfa5-4246-a878-c3eb08f5c113 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.604568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.630095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.630636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.630917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.631215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.631922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.633334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.658488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 390/801] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:03:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:03:58.660316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242db8c-aeaf-414f-bfb7-a87f9ad76ad3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.664111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.710001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.710497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.710772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.711044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.724418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:03:58.730306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:58.731376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:58.732259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 412/802] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:58.732945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.764561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.810851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c29a-6eca-4836-9373-2ae9871cf89a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.851565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.851800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5dd35-0938-43e7-870b-ef0e391e714a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:58.852218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.852498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.852770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.864405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.865854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:58.881519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:58.882410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:58.883359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:58.883359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:58.883359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:58.883359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:58.883359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 391/803] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:58.884105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:58.894810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:58.895673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.896104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.896374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.897065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:58.897362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:58.898721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154688c0-ff4f-41d6-8c3e-f164fa640911 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:58.907387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:58.911779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 413/804] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:58.913060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b652-5822-4381-9026-c52c2137d3f4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:58.913342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b652-5822-4381-9026-c52c2137d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:58.913612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b652-5822-4381-9026-c52c2137d3f4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:58.915128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 414/805] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:03:58.915707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b652-5822-4381-9026-c52c2137d3f4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.004532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe389b89-ba48-4d7d-b999-2b74d4b4c174 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.005116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.028587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b652-5822-4381-9026-c52c2137d3f4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.041232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.041856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.042138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.042414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.043122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:59.043528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.044879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.058175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 392/806] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:59.058175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.070074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.070688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.070973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.071286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.075461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:59.075774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.077217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94941083-344d-4be7-b980-528173fdf2b7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.090331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 415/807] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:59.091829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.092118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.092391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.110103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:03:59.111483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:03:59.158001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.186519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eea97-aaf8-4e9c-aa57-075e8fdcacf4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.191857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 416/808] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:03:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:03:59.192593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.235122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.235789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.236065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.236581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.243098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.244562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:03:59.255808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:59.256723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:03:59.257654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:59.261555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 393/809] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:59.262488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.269178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.300889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797b3fb-c70e-4e60-9b37-886d515f5447 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.335886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.336531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.336813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.337090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.349168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.350732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:03:59.365658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:59.366584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:59.367558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:03:59.367558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:03:59.367558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:03:59.367558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:59.367558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 417/810] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:59.367835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.376701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266d95c-7bd8-41a4-93de-f242a85e9218 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.411228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.411788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.412065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.412332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.420473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.422542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.425785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:03:59.436066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:59.437037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:03:59.438160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:03:59.440545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 394/811] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:59.445728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.483014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920df30-bd5c-4ecb-a551-51afbec824b4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.508238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.521195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.521854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.522123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.522399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] PATH_INFO: `/v3/services/network` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.523022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.524443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:03:59.533499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:03:59.534720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 05:03:59.535827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:03:59.539373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 418/812] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:03:59.540454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.560435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172335a-8b10-4c9f-abd5-3ad0a2d8377d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.596997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.597611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.597895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.598169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.598910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:59.599254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.600687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.618633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 395/813] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:59.618633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.654719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029be08-2b15-4dc7-9ec9-a3f2c5ad2062 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.680408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.692476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.693076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.693355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.693629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.694312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:59.694614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.696026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.708822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 419/814] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:59.709534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.729902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216c46-bedd-462a-860b-ddaf525d57f8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.765674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.766441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.766538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.766844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.767775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:59.767898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.768380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.769500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.788512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 396/815] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:59.789349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.833293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b288a-2221-4924-9031-4da0e2413108 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.868720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.869347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.869614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.869881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.870549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] RBAC: Adding query filter params (name=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:03:59.870847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.872244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.877867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 420/816] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:03:59.878634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.900173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac90348-dd41-41ef-975d-289cb87dac76 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:03:59.918554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:03:59.936453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:03:59.937044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:03:59.937325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:03:59.938113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/71f965b370df48a3a79ba0dd8a2ddf1e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:03:59.940843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=71f965b370df48a3a79ba0dd8a2ddf1e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:03:59.942281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:03:59.967191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 397/817] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:03:59 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/71f965b370df48a3a79ba0dd8a2ddf1e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:03:59.967191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:03:59.994901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128646-fba7-4b8b-9d74-34ad041d6a80 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.017118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:00.045015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.045778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.046119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.046456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.055112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.056726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:00.069880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:00.070906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:00.071883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:00.076273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 421/818] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:00.077200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:00.111185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b914-850c-445c-9d4c-67365885bcb0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.158286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.159378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.161714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.161714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.209680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:00.227036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f6c5-262e-45f4-a89a-0bd0be61685d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.235056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.236604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.275292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.275912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.276185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.276456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.277129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:00.277461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.279331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.287260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 422/819] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:00.288676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:00.340340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:00.352116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 398/820] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:03:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:00.353221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:00.431180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d731d-f440-49c4-9973-9bcde6570adf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.475265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.475265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.475265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.475265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.476030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:00.476030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.477704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.478797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:00.511179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 423/821] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 05:04:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:00.511179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:00.515175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f7c1d-79ba-4aa7-a0d4-faa5c69f5f17 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.599845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.603176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.603176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.603176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.603176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.603176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.631797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:00.642426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8e4f3-fa44-461b-b858-1e2a8c2a18b5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.642771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 399/822] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:00.643634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:00.813001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.813585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.813860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.814128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.845035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.846515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4cf48e67-87b8-4d28-908d-3fa8975eae2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:00.870995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:00.871971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:00.872859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:00.872859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:00.872859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:00.872859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:00.879177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 424/823] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:00.879177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc221-fa60-46d3-b1d4-9e7702bfe304 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.879177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc221-fa60-46d3-b1d4-9e7702bfe304 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.879177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc221-fa60-46d3-b1d4-9e7702bfe304 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.879177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 425/824] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:00.881847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bc221-fa60-46d3-b1d4-9e7702bfe304 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:00.886427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d06fd-28d7-4eb1-b876-ed1a4e416b5e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:00.938884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:00.939540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.939862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.942096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:00.942293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:00.955991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:00.960587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f305e75e-5c42-4dae-adb5-6ffc63af8171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:00.987621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:00.988694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:00.989739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:00.989739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:00.989739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:00.989739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:00.989739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 400/825] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:00.994695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:00.994695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:00.994695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.021148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:01.023735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:01.050617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bc221-fa60-46d3-b1d4-9e7702bfe304 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.089343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.089880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.090256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.090433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.091110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.091441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.092825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.106567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 426/826] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.107396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.110072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.119623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 401/827] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:01.121305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.217346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bcef6-3b03-446e-8052-d2431544fa77 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.245359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605855fe-1dfe-4108-9e57-65f9e766af1b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.251978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.252595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.252875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.253151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.253843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.254150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.255552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.271202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 427/828] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.271406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.271496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.292470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.293107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.293391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.293928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.301854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.304215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:01.318861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:01.320082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 402/829] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:01.320988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.339644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.387786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edc19d-46a3-4d84-87f2-cf27fabaa2be None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.424811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.425450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.425734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.426005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.426621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.427248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d84e-dcfb-46d2-9834-6cc35a2849d2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.428035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:01.437504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:01.438764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:01.439644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 428/830] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:01.440432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.472246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.472981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.473337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.473745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.480340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.481837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:01.494117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:01.494990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:01.495928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:01.499977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 403/831] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:01.501040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.538169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.548988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdf64-477a-4107-b9ae-a5f79f0bc538 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.575966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.587201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.587823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.588104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.588376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.589244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.589714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.591104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.608774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 429/832] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.608970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c532e1-6dfb-4660-96fa-a1dfab60e64b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.609077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.647430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.648047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.648331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.648607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.649275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.649580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.650939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.655732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 404/833] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.656410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.716729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c12b-0477-41ab-ae71-46a584cb0118 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.752627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.753272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.753557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.753836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.754583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.754892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.756363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.768227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 430/834] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.769030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.773720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.778399 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550678e4-b74b-4679-8888-089ea15458e9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.819462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453337-f684-4498-831d-1320540ebc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.820169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453337-f684-4498-831d-1320540ebc60 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.820527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453337-f684-4498-831d-1320540ebc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.820874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453337-f684-4498-831d-1320540ebc60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.821663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25453337-f684-4498-831d-1320540ebc60 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=097e3f30073e48ec832b53d8f89d0d16) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.821967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25453337-f684-4498-831d-1320540ebc60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.822831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:01.823969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25453337-f684-4498-831d-1320540ebc60 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.839200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 405/835] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/role_assignments?user.id=097e3f30073e48ec832b53d8f89d0d16&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.839200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453337-f684-4498-831d-1320540ebc60 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:01.901602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981093f-92b2-4ed5-b6c3-4f79edd68815 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:01.941307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:01.942050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:01.942642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:01.943046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:01.943828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:01.944229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:01.945750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cb326-fddf-48eb-8081-64913d0e56da None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:01.959735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 431/836] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:01.975101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453337-f684-4498-831d-1320540ebc60 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:02.018631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc81a3-f9a2-4f4d-baa8-088bb4744de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:02.019463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc81a3-f9a2-4f4d-baa8-088bb4744de9 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.019883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc81a3-f9a2-4f4d-baa8-088bb4744de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.020235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc81a3-f9a2-4f4d-baa8-088bb4744de9 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/a93912065a104431952b02803d7c3c26/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.039174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc81a3-f9a2-4f4d-baa8-088bb4744de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=a93912065a104431952b02803d7c3c26, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:02.040775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc81a3-f9a2-4f4d-baa8-088bb4744de9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:02.057093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 406/837] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:04:01 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/a93912065a104431952b02803d7c3c26/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:04:02.132032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f716d6-69a1-47e8-aec8-00f69b7d5176 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.132314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f716d6-69a1-47e8-aec8-00f69b7d5176 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.132602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f716d6-69a1-47e8-aec8-00f69b7d5176 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.133968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 432/838] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:02.139791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.140076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.140341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.160493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:02.161617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:02.175039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:02.240605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 407/839] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:02.265172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f716d6-69a1-47e8-aec8-00f69b7d5176 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:02.376710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f716d6-69a1-47e8-aec8-00f69b7d5176 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:02.387757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:02.414005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:02.414630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.414845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.415114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.427304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:02.432198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:02.433160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:02.434663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 433/840] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:02.439371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:02.545494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150655-57ea-401e-a129-c8a8275f3741 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:02.583324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:02.583948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.584231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.584504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.585210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:02.585514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:02.586938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:02.596198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 408/841] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:02.604267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:02.715275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419f63f-c47b-4a51-afb9-93b1020539b4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:02.752584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:02.753233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.753516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.753792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.765479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:02.767132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:02.782859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:02.784939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:02.786760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:02.786760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:02.786760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:02.786760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:02.786760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 434/842] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:02.790189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:02.799251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:02.895511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efa0e2-083a-459c-bfeb-ee80cf61defe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:02.929231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:02.929843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:02.930122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:02.930394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:02.931069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:02.931398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:02.932757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:02.945401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 409/843] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:02.950962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:02.977860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:03.062026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70633-30ff-484b-88a1-adfb308ad5fa None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:03.098283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:03.098930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:03.099289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:03.099571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:03.107454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:03.108903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:03.121800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:03.122801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:03.123778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 435/844] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:03.130975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:03.206634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:03.243180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63adaf-f73f-4415-8f36-981e79a6f4b4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:03.281094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:03.281892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:03.282176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:03.282448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:03.283263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:03.283569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:03.284985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:03.303593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 410/845] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 05:04:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:03.309073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:03.399953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:03.420757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9ade1-157c-4e38-9085-ff113855d54b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:03.456977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:03.457904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:03.458380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:03.458871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:03.529180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:03.530986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:03.616373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:03.638466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 436/846] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:03.644500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:03.750871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19a99-efc0-40b0-a9f1-f3b5c57ff824 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:03.775729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:03.787191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:03.787776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:03.788058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:03.788331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:03.800360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:03.801814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:03.817203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:03.818170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:03.819086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:03.819086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:03.819086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:03.819086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:03.819086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 411/847] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:03.825779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:03.930332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6924-efb3-4646-8bd2-387de532708c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:03.966609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:03.967626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:03.968116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:03.968640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:03.969685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:03.970181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:03.971847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723583e8-86e6-448e-959b-5142991f0314 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:03.984082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 437/848] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:03.990715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.040243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa97c-1ccc-497e-a148-beb1b0587ed6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.040862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa97c-1ccc-497e-a148-beb1b0587ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.041357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa97c-1ccc-497e-a148-beb1b0587ed6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.043282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 438/849] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:04.050192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a59a6-c468-468d-984d-e59d519ca4c6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.050482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a59a6-c468-468d-984d-e59d519ca4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.050801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a59a6-c468-468d-984d-e59d519ca4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.073379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-724a59a6-c468-468d-984d-e59d519ca4c6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:04.076147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-724a59a6-c468-468d-984d-e59d519ca4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:04.112279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9631e-4263-48cb-b454-a197714eb5be None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.124445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.159805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.160475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.160759 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.161030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.168091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.169531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:04.175683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 439/850] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:04.176822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a057a-b9e1-4530-8caa-ba2db61e1f72 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.177207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a057a-b9e1-4530-8caa-ba2db61e1f72 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.177574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a057a-b9e1-4530-8caa-ba2db61e1f72 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.182777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 440/851] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:04.184190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.184480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.184759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e09bc865-1c12-4c18-a058-0d1d42435ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:04.191001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:04.191983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:04.192859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:04.195096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 412/852] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:04.196389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d82de-8c2d-4efe-814b-8f711381bb3a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.196679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d82de-8c2d-4efe-814b-8f711381bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.196952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d82de-8c2d-4efe-814b-8f711381bb3a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.198224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 413/853] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:04.199175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d82de-8c2d-4efe-814b-8f711381bb3a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.205098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:04.206284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:04.236045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.274095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 441/854] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:04.274713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.309398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d82de-8c2d-4efe-814b-8f711381bb3a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.343599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d4bcb-a20b-475e-a10c-ef7b23952a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.344237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d4bcb-a20b-475e-a10c-ef7b23952a83 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.344514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d4bcb-a20b-475e-a10c-ef7b23952a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.344781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d4bcb-a20b-475e-a10c-ef7b23952a83 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.345453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d4bcb-a20b-475e-a10c-ef7b23952a83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.346823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d4bcb-a20b-475e-a10c-ef7b23952a83 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:04.371198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 414/855] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:04 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:04.371198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.371198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.371198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.373022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5489-36da-4c85-b5be-352da1c0b976 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.374720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.390748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:04.392397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:04.420024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.420661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.420943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.421486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.422917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:04.423421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.424967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:04.440541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 442/856] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:04.441395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.479295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 415/857] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:04.480805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.520019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.557261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a79d-52f5-4c98-85e3-6b8d1f7ce374 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.599545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.599736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532c2e-f88b-4800-b815-5f56886cde2e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.600103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.600380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.600650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.601267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.602630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:04.611770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:04.612923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:04.614167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 443/858] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:04.615031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.640230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.641445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.641721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.641986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.643061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=71f965b370df48a3a79ba0dd8a2ddf1e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:04.643397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.644820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:04.650044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.651251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 416/859] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/role_assignments?user.id=71f965b370df48a3a79ba0dd8a2ddf1e&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:04.651251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.764159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.769198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6cba0-11d2-4e61-b9d9-7acd1bbd8ae0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.779721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502422ac-7190-43ec-8954-197d10bc1c2d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.820089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.820975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.821432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.821738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.821841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.822422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:04.822528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.822723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.822821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.822993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.824581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:04.832215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 417/860] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:04.835972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:04.837369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:04.841937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:04.842892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:04.844057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 444/861] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:04.852906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:04.954106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2d66-e3a3-42ce-bd39-ad8ea59c16a4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.959844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:04.985113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c7d5b-f485-4644-a186-9c02b01875fd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:04.993979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:04.994919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:04.995499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:04.995998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:04.996934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:04.997534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:04.999093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:05.005390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 418/862] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:05.031743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:05.032652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:05.033136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:05.033418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:05.034162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:05.034460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:05.035909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:05.045798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 445/863] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:04:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:05.051830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:05.074803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:05.172612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5959-5a5b-4f52-b701-037a3274e938 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:05.210261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:05.210903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:05.211205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:05.211492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:05.223272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:05.224720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:05.239798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:05.240735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:05.242217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:05.242217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:05.242217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:05.242217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:05.242217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 419/864] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:05.246536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:05.352311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7c6c4-7af7-4b94-9584-a8d38bf57cbd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:05.388457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:05.389076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:05.389350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:05.389615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:05.390297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:05.391199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:05.392671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:05.405608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 446/865] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:05.411407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:05.483828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:05.518251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc3415-d5bc-43ab-b0ab-dd1539b5a860 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:05.554719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:05.555386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:05.555663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:05.555933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:05.564441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:05.565918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:05.580086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:05.581132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:05.582496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 420/866] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:04:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:05.587023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:05.591078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:05.690725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5bf5f-7881-4d30-a3ab-df4fac0889b9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:05.726792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:05.727447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:05.727725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:05.727996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:05.728776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:05.729076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:05.730500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:05.749202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 447/867] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 05:04:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:05.756255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:05.858508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b523d1-ac00-4840-b5be-50118017e26c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:05.889556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:05.896726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:05.897390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:05.897668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:05.897936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:05.966231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:05.967754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.066653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 421/868] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:05 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:06.072319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:06.135852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:06.196567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e96d-7aaf-4b6f-afb9-f101a7599d1a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:06.232420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:06.233425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.233900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.234905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.245864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:06.247591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:06.263329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:06.264223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:06.265119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:06.265119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:06.265119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:06.265119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:06.268152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 448/869] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:06.275481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:06.305695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:06.381995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5c173-7eaa-4e63-9780-1546d97ddd0d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:06.418667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:06.419557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.420013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.420435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.421266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:06.422414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:06.424042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdafb97-b331-4724-8d6e-394c5ad3b5a7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.436491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 422/870] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:06.441747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:06.548682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d6067-f827-49d8-9142-ca0ebbd640bc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:06.563205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:06.584083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:06.584725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.584999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.585264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.591232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128555c-7a9e-408c-9346-2356f13fb0ff None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.591729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128555c-7a9e-408c-9346-2356f13fb0ff None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.592113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:06.592796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128555c-7a9e-408c-9346-2356f13fb0ff None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.594087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.595652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 423/871] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:06.604027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92072-6a79-4837-a33c-2af95896769c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.604309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92072-6a79-4837-a33c-2af95896769c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.604579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92072-6a79-4837-a33c-2af95896769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:06.609037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:06.610448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:06.612034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 449/872] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:06.618040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:06.633058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-30a92072-6a79-4837-a33c-2af95896769c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:06.634308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-30a92072-6a79-4837-a33c-2af95896769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:06.708890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 424/873] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:06.728163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4000d7-7e36-4908-90ce-9170f029306d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:06.735229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92072-6a79-4837-a33c-2af95896769c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:06.758740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:06.764432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:06.765118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.765948 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.766220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.766962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:06.767292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:06.768720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c758-c1b7-4484-9939-5aafd042a521 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.782617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 450/874] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:06.789426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621c18e-df04-4606-b915-b8bfc7193ee2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.789704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621c18e-df04-4606-b915-b8bfc7193ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.789998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621c18e-df04-4606-b915-b8bfc7193ee2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.791465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 451/875] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:06.792009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621c18e-df04-4606-b915-b8bfc7193ee2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:06.833769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:06.853224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92072-6a79-4837-a33c-2af95896769c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:06.887589 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:06.888146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.888423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.888694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.889314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:06.891282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e01b591a-1fe2-4dd2-a71e-03f48590dfd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:06.900884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:06.901899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:06.902782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 425/876] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:06.903636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.903636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.903776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.911958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621c18e-df04-4606-b915-b8bfc7193ee2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:06.922601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:06.923952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:06.948280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:06.949151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:06.949523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:06.949792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:06.950677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=a93912065a104431952b02803d7c3c26) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:06.950984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:06.952545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:06.959274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 452/877] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/role_assignments?user.id=a93912065a104431952b02803d7c3c26&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:06.968210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.008647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 426/878] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:07.032819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.052263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:07.102056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:07.106835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5543-ba8a-46e6-ad48-51b94e4ac768 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.153392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.153938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.154217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.154481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.155476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:07.155778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.157316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.164314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 453/879] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:07.170610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.179221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0364-c877-4c25-ae5f-e3ac2456fe53 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.227340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.227340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.227644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.227885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.228508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.230695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:07.243522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:07.244763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:07.245818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 427/880] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:07.252634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.293163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c668657-a935-4fcb-bc8f-8b7c2dcee397 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.328314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.328962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.329244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.329512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.330183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:07.330479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.331895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823eedf-c69c-47c3-98f1-7e9962a1924c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.336853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 454/881] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:07.338011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a928-6c5c-42aa-b3e6-8df1c5ef1172 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.338287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a928-6c5c-42aa-b3e6-8df1c5ef1172 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.338554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a928-6c5c-42aa-b3e6-8df1c5ef1172 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.344506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 455/882] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:07.344506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a928-6c5c-42aa-b3e6-8df1c5ef1172 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.347568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:07.371368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:07.371767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1324b1b-43ca-4b48-aec8-cfb31a54e067 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.411010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.411583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.411867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.412142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.412811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:07.413115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.414474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848fbac-b06c-478c-babe-5dca4bbd0bc4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.419239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 428/883] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:07.420452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.420741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.421016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.439898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:07.441098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:07.457577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a928-6c5c-42aa-b3e6-8df1c5ef1172 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.492301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.492917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.493195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.493464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.494208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] RBAC: Adding query filter params (interface=public, service_id=357b191fd5ba4c41be7d277ca26c85e3, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:07.494511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.495915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.503503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 456/884] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:04:07 2022] GET /identity/v3/endpoints?service_id=357b191fd5ba4c41be7d277ca26c85e3&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:07.504281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.523283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 429/885] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:07.524265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.599872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:07.618857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:07.631663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f44b8f-0c2e-4b0f-9f30-8a13d0b6d5ba None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.632800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6deaf-a179-4e5f-b4fa-391e0d6d507b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.666926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.667505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.667795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.668057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.668554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d743-e189-4874-bb9b-02b437fbd8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.668756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:07.669022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.669178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d743-e189-4874-bb9b-02b437fbd8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.669440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d743-e189-4874-bb9b-02b437fbd8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.669710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d743-e189-4874-bb9b-02b437fbd8b8 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.670344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d743-e189-4874-bb9b-02b437fbd8b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.670437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.672204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d743-e189-4874-bb9b-02b437fbd8b8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.683551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 457/886] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:07.683551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:07.683870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 430/887] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:04:07 2022] GET /identity/v3/services => generated 1011 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:04:07.805968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb55b8-3257-4b55-bb36-d9824b109f81 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:07.845787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f894f-9bef-4939-9bfe-842a7cf1c7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:07.846421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f894f-9bef-4939-9bfe-842a7cf1c7b2 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:07.846702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f894f-9bef-4939-9bfe-842a7cf1c7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:07.846975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f894f-9bef-4939-9bfe-842a7cf1c7b2 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:07.847716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f894f-9bef-4939-9bfe-842a7cf1c7b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:07.849272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f894f-9bef-4939-9bfe-842a7cf1c7b2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:07.875120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 458/888] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:07 2022] POST /identity/v3/services => generated 269 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:09.106088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb61dc4-6e9b-4f39-b2f8-00fe9a7ba264 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.107141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb61dc4-6e9b-4f39-b2f8-00fe9a7ba264 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.107642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb61dc4-6e9b-4f39-b2f8-00fe9a7ba264 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.109997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 431/889] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:09.115188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.115968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.116455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.135407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:09.136839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:09.146537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:09.213126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 459/890] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:09.236242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb61dc4-6e9b-4f39-b2f8-00fe9a7ba264 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:09.347135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb61dc4-6e9b-4f39-b2f8-00fe9a7ba264 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:09.385337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:09.385970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.386245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.386511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.389221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:09.398212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:09.404463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:09.405421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:09.407195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 432/891] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 05:04:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:09.413087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:09.516673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9302-a43a-4a76-b6ee-1211be28e2b8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:09.551323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:09.551938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.552214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.552484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.553190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:09.553488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:09.554846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:09.563868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 460/892] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:04:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:09.569340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:09.677592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9f60-4489-4fcb-8507-2dd250ab0faf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:09.713709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:09.714349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.714618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.714950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.726849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:09.728322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-693e09e9-68f7-4572-9944-60daed8729f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:09.743964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:09.744928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:09.745832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:09.745832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:09.745832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:09.745832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:09.745832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 433/893] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:09.752135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:09.755318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:09.799899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c35ea-4c35-413d-bb8c-a0c7a5af4baa None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.800215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c35ea-4c35-413d-bb8c-a0c7a5af4baa None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.800447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c35ea-4c35-413d-bb8c-a0c7a5af4baa None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.802019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 434/894] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:09.807173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d35ea-6e39-416e-8667-648311ee0ed9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.807474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d35ea-6e39-416e-8667-648311ee0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.807746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d35ea-6e39-416e-8667-648311ee0ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.826255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2a0d35ea-6e39-416e-8667-648311ee0ed9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:09.827481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2a0d35ea-6e39-416e-8667-648311ee0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:09.866878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023771e0-1d8b-48c5-9920-e885688c37f2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:09.871917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:09.897516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 435/895] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:09.898760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d93813-95fc-4e44-b68e-2feb5c4ed631 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.899037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d93813-95fc-4e44-b68e-2feb5c4ed631 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.899332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d93813-95fc-4e44-b68e-2feb5c4ed631 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.900715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 436/896] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:09.906069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afe742-04e4-459b-8a55-8d01fb8e7785 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.906232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afe742-04e4-459b-8a55-8d01fb8e7785 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.906508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afe742-04e4-459b-8a55-8d01fb8e7785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.915581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:09.916400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.916855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.917272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:09.918101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:09.918547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:09.920563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:09.925426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-41afe742-04e4-459b-8a55-8d01fb8e7785 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:09.926625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-41afe742-04e4-459b-8a55-8d01fb8e7785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:09.934039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 461/897] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:09.934790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:09.994458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:09.995973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 437/898] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:09.997220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e984-7fb3-445e-bc78-bf58380057c3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:09.997507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e984-7fb3-445e-bc78-bf58380057c3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:09.997782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e984-7fb3-445e-bc78-bf58380057c3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.003353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 438/899] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:10.003353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e984-7fb3-445e-bc78-bf58380057c3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.037545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7da0e-8d5e-441a-a5e7-08e5f6756737 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.070543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.071182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.071499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.071741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.072348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.073965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c0b3cca6-050b-4ce3-bf9b-b8c4a263ef9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:10.083200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:10.084193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:10.085031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 462/900] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:10.085925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.085925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.085925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.104085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:10.105261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:10.115555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e984-7fb3-445e-bc78-bf58380057c3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.125118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.150606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.151252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.151533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.151797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.159135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.160584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.172946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 463/901] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:10.173554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:10.174388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:10.175349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 439/902] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:04:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:10.180976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.234067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.276842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11fe82-3a49-4413-9bcb-5da59bafa27d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.284338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f31e-648e-4547-83b9-cc402127b73e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.309394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.310007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.310288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.310551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.311254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.313171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.317474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.318079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.318358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.318636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.319389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:10.319737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.321109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.325986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 440/903] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:10.326742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.338152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 464/904] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:10 2022] POST /identity/v3/services => generated 241 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:10.338152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.375533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.450435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a80667-b9e2-4051-a9f7-47f7a9aec177 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.456667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d494a-d86b-446f-b0c8-329ef23b5dc2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.465673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.492169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.492994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.492994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.493261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.493868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.495522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.502552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.503320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.503606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.503877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.504667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:10.504856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:10.505736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:10.506574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:10.507394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.507465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 465/905] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:10.507551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.507716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.525732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 441/906] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:10.526560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.615553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f8ca8-5c5f-4843-84a9-8d9a1eba948c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.625392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.637640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46c08-40fa-4fe3-a673-596e5224ce1e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.654893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.655538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.656481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.656847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.657600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:10.658125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.659389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.669034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 466/907] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:10.669034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.681117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.681738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.682016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.682282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.682951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:10.683292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.684678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.689489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 442/908] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:10.690295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.715331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.778711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99697-0a14-4225-bcd4-ed08a07db28c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.796234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c51b1-cc99-4c44-aaba-b58e068d1721 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:10.816041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.816752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.817097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.817436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.835387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:10.836007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:10.836286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:10.836557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:10.837256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.838607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.871187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 443/909] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:10.871187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:10.884294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.914744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:10.917517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:10.969650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:10.998849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18ea0-1736-48d7-abdc-fa1545a28d34 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.038419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469d84-419a-45ca-b660-551971c6829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.038973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 467/910] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:11.039086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469d84-419a-45ca-b660-551971c6829f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.039382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469d84-419a-45ca-b660-551971c6829f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.039533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469d84-419a-45ca-b660-551971c6829f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.040183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469d84-419a-45ca-b660-551971c6829f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:11.040486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469d84-419a-45ca-b660-551971c6829f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.041869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469d84-419a-45ca-b660-551971c6829f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.044331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.048628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 444/911] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:11.054525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469d84-419a-45ca-b660-551971c6829f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.137913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:11.180231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469d84-419a-45ca-b660-551971c6829f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.181282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b9b1-4c56-4238-92de-d5c3cf096947 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.221026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.221674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.221943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.222210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.223516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.224467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.225027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.225520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.226463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] RBAC: Adding query filter params (interface=public, service_id=0a8f995a4c8f4d28b6d6464762528e4f, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:11.226973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.228671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.230353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:11.232936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.234841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.238118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 445/912] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/endpoints?service_id=0a8f995a4c8f4d28b6d6464762528e4f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:11.242659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:11.255183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:11.256125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:11.257602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:11.257602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:11.257602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:11.257602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:11.257602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 468/913] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:11.261650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.360673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ffc4-a986-485a-a8ac-68c0e3b84b84 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.368683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9547f-06d9-479a-8e76-3f69b90b8bb9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.398430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.399484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.399971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.400475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.401358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.402916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.403026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.403564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.403839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.404107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.404811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:11.405080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.406945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.411500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:11.412061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 446/914] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:04:11.425716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 469/915] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:11.426809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.546620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c54176-90e7-4a37-86b7-dd56727a3dad None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.584239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.584883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.585166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.585442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.592570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.594647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:11.607555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:11.608460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:11.610562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 447/916] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:11.617179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.674099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:11.734970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de1112-8f7f-4b49-884e-002250fadf6b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.770711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.771350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.771627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.771893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.772837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:11.773141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.774649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7866b3b-9715-4ed0-aba6-39897af96e67 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.787107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 470/917] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:11.792659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:11.858767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:11.902712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0984d92-dc5e-4071-89fc-f89a034d8c52 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:11.939085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:11.940118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:11.940648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:11.941125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:11.942176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] RBAC: Adding query filter params (role.id=f550db3e8ba9469aa0b87bb6577a5468, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=a93912065a104431952b02803d7c3c26) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:11.942701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:11.944372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94dcb5-82ed-4789-b83a-6ae99887b10c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:11.951130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 448/918] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:11 2022] GET /identity/v3/role_assignments?user.id=a93912065a104431952b02803d7c3c26&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=f550db3e8ba9469aa0b87bb6577a5468 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:12.449695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665caa-e149-4e25-882f-0963215e92c1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:12.450188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665caa-e149-4e25-882f-0963215e92c1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:12.450188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665caa-e149-4e25-882f-0963215e92c1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:12.451954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 471/919] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:12.457224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:12.457638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:12.457826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:12.476659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:12.477878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:12.550192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 449/920] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:12.572733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665caa-e149-4e25-882f-0963215e92c1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:12.682000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665caa-e149-4e25-882f-0963215e92c1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:12.695563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:12.717650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:12.718766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:12.719216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:12.719690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:12.720332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:12.721695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:12.730699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:12.731873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:12.733321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 472/921] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:12.738485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:12.797994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:12.846300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe17f7-de04-475c-9e4e-79f98f84f7a5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:12.881125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:12.882079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:12.882557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:12.883035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:12.883920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:12.884417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:12.885977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:12.891847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 450/922] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:12.902446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.012791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2df3-b03e-4839-a546-f8513859d3d8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.052882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.053175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.053272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.053531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.054267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:13.054578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.056036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20284133-7cd6-430a-9f06-830252ecc88e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.062868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 473/923] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:13.069088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.108020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8deec-365f-46d7-9b27-e0b77ac31547 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.108352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8deec-365f-46d7-9b27-e0b77ac31547 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.108578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8deec-365f-46d7-9b27-e0b77ac31547 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.110711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 474/924] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:13.116306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.116588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.116861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.137189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:13.138436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:13.179809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:13.200210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f00ce-cc0c-4147-af9e-883d760d0baa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.221110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:13.231225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 475/925] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:13.247854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.248698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.249174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.249774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.251207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.253348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] RBAC: Adding query filter params (interface=public, service_id=5d1b09b827184b36ad91e0677dc2ec3b, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:13.253896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.256426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.263733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 451/926] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:04:13 2022] GET /identity/v3/endpoints?service_id=5d1b09b827184b36ad91e0677dc2ec3b&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:13.271217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.380301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb07c5a-e46d-4c1d-b543-fac7f437f0da None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.388994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767b814-b0be-417a-a614-ba90c94e3553 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.425982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.426936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.427391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.427697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.428007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.428559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.428958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.429163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.429416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.430188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.431063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.431818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.434754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING keystone.server.flask.common [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 05:04:13.447697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 452/927] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:04:13 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:04:13.456933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.sql.core [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 05:04:13.456933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 05:04:13.456933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [parameters: {'id': '8ae40bd16c184555a57267ea22256638', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 05:04:13.456933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80353) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a2af0bb7-03e0-4844-b9d2-498b9d602600 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ae40bd16c184555a57267ea22256638.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ae40bd16c184555a57267ea22256638. Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 05:04:13.466877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 05 05:04:13.467837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application yield resource Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise self.value Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application session.commit() Aug 05 05:04:13.469390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.flush() Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application compat.raise_( Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 05:04:13.470296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 05:04:13.471246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 05:04:13.472064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [parameters: {'id': '8ae40bd16c184555a57267ea22256638', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.472945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:13.473738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ae40bd16c184555a57267ea22256638. Aug 05 05:04:13.474686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.477596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 476/928] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Aug 5 05:04:13 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:13.483762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.547991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:13.590198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351767-e5c0-4c0d-bf0f-47389c777455 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.590478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351767-e5c0-4c0d-bf0f-47389c777455 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.590754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351767-e5c0-4c0d-bf0f-47389c777455 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.600913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 477/929] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:13.602249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.602531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.602806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.616116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96988e5-5560-4519-89ef-3b1d823d4189 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.627264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:13.628791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:13.656579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:13.663393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.664510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.664801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.665077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.673998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.675688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:13.693771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:13.694782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:13.695777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 453/930] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:13.704300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.718342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 478/931] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:13.748903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:13.819214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ca29-779e-428f-b709-ffe9be3962a8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.822534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:13.863668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.864292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.864576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.864850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.865564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:13.865965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.867539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.869287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9021-e262-4547-abd7-528fedb00b0d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:13.895544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 454/932] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:13.906572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:13.907384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:13.907668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:13.907942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:13.908592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:13.910159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-66ae3f1c-6f3b-45a9-8c79-435125ae40ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:13.920173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:13.921305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:13.922350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 479/933] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 5 05:04:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:13.929990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.047234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73275b6-bc3d-4fce-b7a8-6c8e17ee163d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.047566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73275b6-bc3d-4fce-b7a8-6c8e17ee163d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.047807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73275b6-bc3d-4fce-b7a8-6c8e17ee163d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.048674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b5ee7-5374-4eef-aa4e-b1b4239776e2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.050625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 480/934] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:14.055126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.055434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.055712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.075711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:14.076818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:14.088301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.089082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.089433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.092048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.092048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:14.092048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:14.092374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:14.094119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:14.098300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 455/935] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:14.104600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.141802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:14.165839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 481/936] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:14.190894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.250939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a9c6-a7ce-41f5-9aac-7550c9062aa4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.289503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.290118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.290396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.290668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.291421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:14.291726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:14.293085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:14.303492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 456/937] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:14.304537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.312878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593d86-8826-4113-85d4-f8f42a48a9b9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.360062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.360935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.361357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.362304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.377778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:14.384281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:14.385395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:14.386415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:14.388689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 482/938] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 05:04:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:14.394616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.408076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:14.413821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:14.428458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cde5-4823-4258-8666-490f6450d270 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.472088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.472902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.473252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.473623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.474500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:14.476126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:14.507209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 457/939] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:04:14.514547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe15b-b607-4f23-9d68-bc41fd7ef3a5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.564483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.565181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.565465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.565734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.566446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:14.566749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:14.568181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:14.583800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 483/940] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:04:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:14.585744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.704970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a397-0c82-4208-bd3f-f7fa3530a37c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.742166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.743199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.743767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.744234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.756021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:14.757722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:14.766921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:14.773956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:14.774865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:14.777559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:14.777559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:14.777559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:14.777559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:14.778239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 458/941] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:14.782940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:14.854589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:14.889797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0047d2-54dd-47b7-8e22-046137d3943c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:14.924667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:14.925336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:14.925621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:14.925891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:14.926578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:14.926880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:14.928281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:14.945387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 484/942] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:14.946789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.057748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a460df0-1ac5-41aa-a33b-fcec382ae0b1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.095690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:15.096335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.096618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.096895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.105875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:15.107402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:15.119207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:15.120184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:15.121152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 459/943] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:04:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:15.126494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.239486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21e5f-671a-492a-9c3d-aacc5135d393 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.267721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:15.275643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:15.276298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.276591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.276861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.277644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:15.277949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:15.279458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:15.303267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 485/944] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:15.304817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.367628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:15.409629 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a13b43-7be3-462b-b97a-0e58a9cbb134 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.451402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:15.452045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.452329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.452692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.463745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:15.465186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-72590936-c165-458c-a6bd-884ddad67504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:15.480397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:15.481391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:15.482373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:15.482373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:15.482373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:15.482373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:15.482373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 460/945] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:15.487578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.552018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d2ee5-0ebf-414b-a45f-f0308a582f66 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.552563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d2ee5-0ebf-414b-a45f-f0308a582f66 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.552563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d2ee5-0ebf-414b-a45f-f0308a582f66 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.554158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 461/946] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:15.559039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.559372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.559652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.578608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:15.579845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:15.594034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a09c-2e59-443c-9403-88975e3a5c74 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.637436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:15.637980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.638416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.638701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.639555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:15.639900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:15.641470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:15.659639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 486/947] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:15.660171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 462/948] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:15.660543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.683584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.722139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:15.735573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:15.793159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69522f5-21a9-4247-a51d-f1e893a3fd5a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.800569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dff7a-dc6d-42ed-a159-ea020ce1b3c8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.832140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:15.832883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.833237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.833583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.842449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:15.844732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:15.847010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:15.848092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:15.848373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:15.848647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:15.849272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:15.850633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:15.857171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:15.858090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:15.859048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:15.861815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:15.864170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:15.866215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 463/950] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:15.868142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 487/950] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:15.868296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.871185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:15.980269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ebd7d-868f-4f5c-9cb8-f110cbe95db3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:15.989573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:15.998721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44ff91-ecc8-4ad2-92ca-7f4ffc92656e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.008865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:16.025225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.025850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.026132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.026401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.027377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:16.027682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.029229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.040187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 488/951] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:16.041789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.050468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.051089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.051398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.051672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.052412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:16.052718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.054145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.071195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 464/952] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:16.077100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.157657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2c4c-89cd-487e-973e-e501c2a706e7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.190317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fe111-c0ed-47f4-8768-343906c4cb9b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.202478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.203238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.203505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.203781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.204502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:16.204801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.206187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c16d-5eef-44c5-bfc8-dc99cb1a4478 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.211040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 489/953] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:16.212208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381b559-4906-498d-be5b-b31d1cb495c9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.212481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381b559-4906-498d-be5b-b31d1cb495c9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.212749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381b559-4906-498d-be5b-b31d1cb495c9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.215196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 490/954] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:16.216380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381b559-4906-498d-be5b-b31d1cb495c9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.240756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8c9d8-8495-49e1-bba1-b68f00b95535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.241828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c9d8-8495-49e1-bba1-b68f00b95535 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.242123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c9d8-8495-49e1-bba1-b68f00b95535 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.242404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c9d8-8495-49e1-bba1-b68f00b95535 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/a93912065a104431952b02803d7c3c26/roles/f550db3e8ba9469aa0b87bb6577a5468` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.244647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8c9d8-8495-49e1-bba1-b68f00b95535 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=a93912065a104431952b02803d7c3c26, role_id=f550db3e8ba9469aa0b87bb6577a5468)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.246077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8c9d8-8495-49e1-bba1-b68f00b95535 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.256973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:16.271197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 465/955] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:04:16 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/a93912065a104431952b02803d7c3c26/roles/f550db3e8ba9469aa0b87bb6577a5468 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:04:16.271197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.271197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.271197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.297231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:16.299804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:16.326188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:16.355022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381b559-4906-498d-be5b-b31d1cb495c9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.395766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 466/956] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:16.399943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.400896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.401386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.401877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.402820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.404586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.422503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.440507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 491/957] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:16.545656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c32886-042c-4aa3-9748-eac5ca98dea4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.596177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.596968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.597156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.597422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.598102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.599633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.602209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING keystone.server.flask.common [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 05:04:16.615499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.sql.core [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 05:04:16.615499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 05:04:16.615499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [parameters: {'user_id': 'ddd4a186cf5e40fdb79eb650a3c0488b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 05:04:16.615499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-bbb18386-c336-4b7d-800f-3737c263a360 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application conn.query(q) Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result.read() Aug 05 05:04:16.631945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 05:04:16.632930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application next(self.gen) Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application yield resource Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application next(self.gen) Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise self.value Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application session.commit() Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 05:04:16.633938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.session.flush() Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application compat.raise_( Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 05:04:16.634866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 05:04:16.635812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application conn.query(q) Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result.read() Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 05:04:16.636681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ddd4a186cf5e40fdb79eb650a3c0488b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:16.638758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 05 05:04:16.640337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.643719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 467/958] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 05:04:16 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:16.644620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.659603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59160b-26f0-4c0a-84b5-f31523daebcf None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.659897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59160b-26f0-4c0a-84b5-f31523daebcf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.660151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59160b-26f0-4c0a-84b5-f31523daebcf None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.664729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 468/959] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:16.670634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.670920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.671741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.692793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:16.694308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:16.705431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:16.755728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:16.767175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090db2b-7a86-46ed-9cec-b051e5aabbb0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.779177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 469/960] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:16.794898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.825781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.825781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.825781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.825781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.835483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.837218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:16.850916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:16.852002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:16.852984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 492/961] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:16.857733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.920301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ddbb3-0716-4ff4-93ce-953a0cb8af50 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:16.957420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:16.958064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:16.958345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:16.958618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:16.959299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:16.960788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:16.970483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:16.971529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:16.972461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 470/962] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:16.978101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:16.990151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:17.004327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342505-0656-465d-8d3e-ae6216dc065e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:17.049664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:17.050828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:17.051939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:17.052431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:17.053628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:17.054119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:17.056856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:17.095676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96ea4e-fc82-4d59-b60a-d8f98d09c80e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:17.105081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 493/963] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 05:04:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:17.139688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:17.141080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:17.141507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:17.141915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:17.142780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:17.143305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:17.144850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c82502-f93a-4589-9f21-a676f032b0ce None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:17.150922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 471/964] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:17.157630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:17.170814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:17.270363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1359a-5733-40bd-9224-ecf2d995f84b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:17.306683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:17.307365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:17.307619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:17.307886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:17.308603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:17.308906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:17.310319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ad66e-8370-45a2-9f10-e3a80e0ddacf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:17.316215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 494/965] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:18.429370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419370a8-80ef-478b-abad-a2ae1222fbfb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.429873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419370a8-80ef-478b-abad-a2ae1222fbfb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.429873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419370a8-80ef-478b-abad-a2ae1222fbfb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.431327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 472/966] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:18.436231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43415-7df7-4aa4-a5e7-1fdcc6e86453 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.437134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43415-7df7-4aa4-a5e7-1fdcc6e86453 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.437308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43415-7df7-4aa4-a5e7-1fdcc6e86453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.455369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-85f43415-7df7-4aa4-a5e7-1fdcc6e86453 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:18.456536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-85f43415-7df7-4aa4-a5e7-1fdcc6e86453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:18.523878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 495/967] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:18.547217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419370a8-80ef-478b-abad-a2ae1222fbfb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:18.581583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c9d2-43fb-4de9-8ff8-48ca8c23cc67 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.581896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c9d2-43fb-4de9-8ff8-48ca8c23cc67 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.582141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c9d2-43fb-4de9-8ff8-48ca8c23cc67 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.584558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 496/968] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:18.589193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.589470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.589737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.597003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:18.608823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:18.610009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:18.632443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:18.673773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419370a8-80ef-478b-abad-a2ae1222fbfb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:18.679320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 497/969] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:18.702273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:18.710221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:18.710998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.711124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.711427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.723394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:18.728752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:18.729719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:18.730576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 473/970] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 05:04:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:18.736256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:18.817623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30b24-558f-468a-a421-8a7d5906b5e9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:18.844882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7dcc2-21d3-48a3-805a-474c40cb4182 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:18.849910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:18.856445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:18.857407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.857835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.858116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.858782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:18.860208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:18.870041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:18.871074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:18.871975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 498/971] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:18.877411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:18.881264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:18.887099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:18.887744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:18.888020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:18.888295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:18.889025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:18.889326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:18.891464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:18.900487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 474/972] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:04:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:18.906320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:18.985387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551758-f1b4-4ff4-bb75-fa606d177f01 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.009950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4833f-c588-4e4e-b2c4-5ef3e2a7500a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.021012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.021625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.021898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.022169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.022827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:19.023127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.024727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.029887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 499/973] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:19.035584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.049155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.049842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.050122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.050389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.060988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.062505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:19.077988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:19.079025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:19.079970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:19.079970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:19.079970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:19.079970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:19.083917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 475/974] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:19.084577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.100860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.133766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.146571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d073-7035-49c9-9fd2-cbd687620c9f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.184340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.185274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.185760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.186244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.187316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:19.187835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.189388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.194932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 500/975] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:19.197171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110139-fc5c-424b-a64d-b3f56f7c4e6d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.201272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.232884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.233523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.233868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.234140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.234865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:19.235185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.236606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.248934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 476/976] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:19.255375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.311177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71cb52-3f80-4756-92c2-4bc72c72977b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.335912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.347082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.347718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.347998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.348265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.349020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] RBAC: Adding query filter params (interface=admin, service_id=5d1b09b827184b36ad91e0677dc2ec3b, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:19.349326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.350685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2573e-2e9e-4f4d-a370-a23135eb9662 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.355573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 501/977] 10.222.0.27 () {56 vars in 1249 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/endpoints?service_id=5d1b09b827184b36ad91e0677dc2ec3b&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:19.356771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a43e89-02a5-4be6-be4c-80306b6d0f82 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.357073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a43e89-02a5-4be6-be4c-80306b6d0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.357333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a43e89-02a5-4be6-be4c-80306b6d0f82 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.357931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe7b3-9e5f-436a-adf8-e562cdd47b23 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.359291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 502/978] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:19.362283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a43e89-02a5-4be6-be4c-80306b6d0f82 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.367451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.394444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.395063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.395362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.395630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.402630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.404091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-041f96ce-56d8-4e7f-95bb-0b6f8c8c253a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:19.416219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:19.417179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:19.418281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 477/979] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:19.419112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.419112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.419112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.437209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:19.438375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:19.465634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a43e89-02a5-4be6-be4c-80306b6d0f82 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.499145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.499882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.500168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.500438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.501075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.502428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.504394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 478/980] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:19.505207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.508938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 503/981] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:04:19.527995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.588847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.617530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.626396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f490bf-fda2-48c7-9e22-4f9e763b01c8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.648585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b859-f9dc-4204-9959-4940290dd044 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.667520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.668147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.668411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.668682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.669467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:19.669766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.671869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.689196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.689811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.690090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.690366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.691040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.692452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 479/982] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:19.692567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:19.698631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:19.709549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 504/983] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:19 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:04:19.817954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d8bb0-4422-45b1-a788-e2c18343ec9f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:19.863533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:19.864156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:19.864434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:19.864700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:19.885523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:19.935015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:19.936479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:20.041173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 480/984] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 05:04:20.042849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:20.144761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664c84d-c189-4af7-9285-287746b76b4c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:20.157844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:20.188163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:20.188802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:20.189076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:20.189345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:20.200688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:20.202145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:20.217145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:20.218106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:20.219036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:20.219036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:20.219036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:20.219036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:20.219036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 505/985] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:20.224142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:20.275128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:20.325685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda92b6-985e-4d3b-bea0-ce3d47399d84 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:20.359215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:20.359817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:20.360089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:20.360349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:20.361017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:20.361312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:20.362654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:20.373937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 481/986] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:20.379334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:20.482118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918af54-b8f7-4757-b410-f02e3a029356 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:20.516080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:20.516699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:20.516977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:20.517247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:20.523980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:20.525474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:20.537262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:20.538151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:20.544061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 506/987] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:20.545789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:20.652286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf549-a819-4a34-8c0a-aea4bd37807e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:20.663574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:20.688274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:20.688883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:20.689161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:20.689428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:20.690155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:20.690463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:20.691897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99406a-719f-4e13-9427-9c7a21b525fe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:20.705268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 482/988] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:20.710945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:20.737317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:20.814704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e79d5f-2953-4d58-a7d9-08253a4a04b8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:20.853859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:20.854471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:20.854749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:20.855016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:20.855848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] RBAC: Adding query filter params (role.id=f550db3e8ba9469aa0b87bb6577a5468, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=a93912065a104431952b02803d7c3c26) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:20.856152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:20.857571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb6e6-6ffb-4023-a3eb-ca038f384702 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:20.871197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 507/989] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:20 2022] GET /identity/v3/role_assignments?user.id=a93912065a104431952b02803d7c3c26&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=f550db3e8ba9469aa0b87bb6577a5468 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:21.547022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5f30b-c548-4879-9e27-536abc6a559d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:21.547545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5f30b-c548-4879-9e27-536abc6a559d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:21.547545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5f30b-c548-4879-9e27-536abc6a559d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:21.548908 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 483/990] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:21.554177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:21.554617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:21.554793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:21.573996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:21.576791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:21.648255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 508/991] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:21.670582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5f30b-c548-4879-9e27-536abc6a559d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:21.790576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5f30b-c548-4879-9e27-536abc6a559d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:21.824773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:21.825382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:21.825665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:21.825936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:21.826553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:21.828455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c0a78920-b02d-4403-8236-1cfa3c49d43c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:21.837489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:21.838456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 05:04:21.839322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:21.843675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 484/992] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 05:04:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:21.845302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:21.863978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:21.883046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5269b-580d-4ea9-85ed-c5225b2397d8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:21.883418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5269b-580d-4ea9-85ed-c5225b2397d8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:21.883617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5269b-580d-4ea9-85ed-c5225b2397d8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:21.885116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 485/993] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:21.890140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:21.890424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:21.890717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:21.909320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:21.910493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:21.940233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:21.953887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0db1f1-86f6-4956-b49c-6513c995a149 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:21.988688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 486/994] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:21.993044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:21.993669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:21.993951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:21.994226 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:21.994900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:21.995229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:21.996603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.001862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 509/995] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:22.007347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.011988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.098688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:22.115996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5c42b-6c1a-474a-aa24-2952b13268a8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.118863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22411e73-eae9-4d14-9944-9ea5ca6eb03f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.154773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.155475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.155757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.156025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.156696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:22.156993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.158347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.158706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.159629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.159983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.160261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.160884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.162230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.164458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 487/996] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 05:04:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:22.170936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:22.178470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:22.179653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:22.180589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 510/997] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:22.185377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.203538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:22.280656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4308-e667-4474-a6d6-128b92ebdcfa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.297392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18ac6d-8b79-4051-b17d-4170582e7cb7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.318409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.319019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.319326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.319597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.320302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.321681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.334619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.335263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.335599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.335797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.336463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:22.336769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.338128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.338877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 488/998] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:22.344077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 511/999] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:22.350175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.450281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:22.472662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0751a97-3b5d-45c0-9b71-313b91db8239 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.509822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.510436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.510715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.510983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.511734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:22.512031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.513380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.518865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 489/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:22.524715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.539064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:22.632734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2d45-63ac-45f8-a0e8-15be91445006 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.666307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.666917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.667231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.667508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.668250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] RBAC: Adding query filter params (interface=public, service_id=eb52fbeca64d459887d9d64720a9dc6e, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:22.668549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.669904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761a72-114a-44b8-a68b-4489ac313691 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.679977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 512/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:04:22 2022] GET /identity/v3/endpoints?service_id=eb52fbeca64d459887d9d64720a9dc6e&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:22.681247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:22.784872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8ce5-50b6-45f8-9e40-b9d9b2f033f9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:22.818711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a48870-5e5d-4e5e-97e7-f994a38c419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:22.819352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48870-5e5d-4e5e-97e7-f994a38c419a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:22.819631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48870-5e5d-4e5e-97e7-f994a38c419a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:22.819900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48870-5e5d-4e5e-97e7-f994a38c419a None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:22.820535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a48870-5e5d-4e5e-97e7-f994a38c419a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:22.821891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a48870-5e5d-4e5e-97e7-f994a38c419a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:22.830328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 490/1002] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:04:22 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:04:23.055086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dc15c-f399-40c6-af3b-e3576eb95b8d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:23.055297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dc15c-f399-40c6-af3b-e3576eb95b8d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:23.055582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dc15c-f399-40c6-af3b-e3576eb95b8d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:23.056936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 513/1003] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:23.062883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:23.063179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:23.063462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:23.082651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:23.083861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:23.091552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:23.167236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 491/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:23.181727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738dc15c-f399-40c6-af3b-e3576eb95b8d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:23.258287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:23.284780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738dc15c-f399-40c6-af3b-e3576eb95b8d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:23.318727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:23.319315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:23.319598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:23.319871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] PATH_INFO: `/v3/services/image` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:23.320488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:23.321853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:23.331675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:23.332654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:23.333488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:23.335305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 514/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 5 05:04:23 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:23.338729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:23.438898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0fdbe-52f9-4640-8d72-bbd971f458e8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:23.474411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:23.475028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:23.475336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:23.475612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:23.476283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] RBAC: Adding query filter params (name=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:23.476586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:23.477954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fe8ac-cc45-4928-a2b2-9ab1324c9f77 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:23.488100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 492/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:23.489422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:23.591281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c518d-720a-40bf-bdc9-7f5c49111106 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:23.624645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:23.625386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:23.625662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:23.625930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:23.626593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] RBAC: Adding query filter params (type=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:23.626890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:23.628309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45935-06af-4102-88fd-91d58ac87c23 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:23.632839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 515/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:24.387692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07564a6-2a37-4fe0-8509-6f48ec5c9d4b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:24.388205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07564a6-2a37-4fe0-8509-6f48ec5c9d4b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:24.388205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07564a6-2a37-4fe0-8509-6f48ec5c9d4b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:24.390089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 493/1008] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:24.395146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:24.395457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:24.395732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:24.401926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:24.415019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:24.416207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:24.482186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 516/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:24.505172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07564a6-2a37-4fe0-8509-6f48ec5c9d4b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:24.514351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:24.613620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07564a6-2a37-4fe0-8509-6f48ec5c9d4b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:24.648134 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15741efd-e274-4564-930a-b92a73176c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:24.648766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15741efd-e274-4564-930a-b92a73176c50 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:24.649043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15741efd-e274-4564-930a-b92a73176c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:24.649310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15741efd-e274-4564-930a-b92a73176c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:24.650433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15741efd-e274-4564-930a-b92a73176c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:24.651874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15741efd-e274-4564-930a-b92a73176c50 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:24.653649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 494/1010] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:24.659137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:24.757355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a70a-24c7-4629-8bf5-54c899b860e2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:24.789491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:24.795561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3f67a-1d39-49a5-be27-90e8f264517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:24.796210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3f67a-1d39-49a5-be27-90e8f264517e None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:24.796488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3f67a-1d39-49a5-be27-90e8f264517e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:24.796755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3f67a-1d39-49a5-be27-90e8f264517e None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:24.797547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3f67a-1d39-49a5-be27-90e8f264517e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:24.798982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3f67a-1d39-49a5-be27-90e8f264517e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:24.835186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 517/1011] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:24 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:24.848314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111274-4a53-4e5f-855c-d00add2d4987 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:24.848669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111274-4a53-4e5f-855c-d00add2d4987 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:24.849008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111274-4a53-4e5f-855c-d00add2d4987 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:24.850482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 495/1012] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:24.856408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:24.856715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:24.856957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:24.875981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:24.877186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:24.951711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 518/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:24.974201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111274-4a53-4e5f-855c-d00add2d4987 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:25.054762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:25.082443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111274-4a53-4e5f-855c-d00add2d4987 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:25.118517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:25.119186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.119475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.119853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.120481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:25.121899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:25.133800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:25.134807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:25.136245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 496/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:25.143962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:25.250992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04016-fb25-4d94-abc2-91c07e0871e2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:25.265712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:25.287342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:25.287964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.288244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.288517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.289192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:25.289503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:25.290869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:25.300598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 519/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:25.301872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:25.406804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922d038-0f6e-4f00-a57f-005782e62af5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:25.440778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:25.441391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.441667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.441935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.442594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:25.442892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:25.444280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3607d7-b483-45ca-aa10-fa9b92a57d0e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:25.449689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 497/1016] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 05:04:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:25.455507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:25.554036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8965ae-375f-46af-ac9f-25a83829194d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:25.587724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eecbc-7dd9-4a93-805f-50eacaf331c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:25.588338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eecbc-7dd9-4a93-805f-50eacaf331c4 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.588612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eecbc-7dd9-4a93-805f-50eacaf331c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.588878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eecbc-7dd9-4a93-805f-50eacaf331c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.589582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eecbc-7dd9-4a93-805f-50eacaf331c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:25.590942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eecbc-7dd9-4a93-805f-50eacaf331c4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:25.619183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 520/1017] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:25.694105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfd85-8d34-41e6-aab8-3e61322f2e16 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.694303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfd85-8d34-41e6-aab8-3e61322f2e16 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.694557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfd85-8d34-41e6-aab8-3e61322f2e16 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.696113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 498/1018] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:25.701746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3913b46-b98a-4372-a375-b5e7db016ee4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.702349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3913b46-b98a-4372-a375-b5e7db016ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.702349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3913b46-b98a-4372-a375-b5e7db016ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.720769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d3913b46-b98a-4372-a375-b5e7db016ee4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:25.721989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d3913b46-b98a-4372-a375-b5e7db016ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:25.752627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:25.804651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 521/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:25 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:25.827675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cfd85-8d34-41e6-aab8-3e61322f2e16 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:25.830764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:25.935052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cfd85-8d34-41e6-aab8-3e61322f2e16 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:25.970486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2e6a2-aca2-41f7-919f-ba3fa3c3d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:25.971028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e6a2-aca2-41f7-919f-ba3fa3c3d71c None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:25.971341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e6a2-aca2-41f7-919f-ba3fa3c3d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:25.971618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e6a2-aca2-41f7-919f-ba3fa3c3d71c None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:25.972302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e6a2-aca2-41f7-919f-ba3fa3c3d71c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:25.973674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e6a2-aca2-41f7-919f-ba3fa3c3d71c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:25.995210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 499/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:25 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:26.907469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6631e-c244-41ff-a9e5-b2e5bb529aaa None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:26.907996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6631e-c244-41ff-a9e5-b2e5bb529aaa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:26.907996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6631e-c244-41ff-a9e5-b2e5bb529aaa None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:26.909494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 522/1021] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:26.914405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:26.914806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:26.914968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:26.933381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:26.934547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:26.991301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:27.009618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 500/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:27.033957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6631e-c244-41ff-a9e5-b2e5bb529aaa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:27.140028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6631e-c244-41ff-a9e5-b2e5bb529aaa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:27.177397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1991ef-1c42-4a09-8749-fd3d95841c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:27.178045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1991ef-1c42-4a09-8749-fd3d95841c4b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:27.178321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1991ef-1c42-4a09-8749-fd3d95841c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:27.178587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1991ef-1c42-4a09-8749-fd3d95841c4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:27.179747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1991ef-1c42-4a09-8749-fd3d95841c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:27.181187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1991ef-1c42-4a09-8749-fd3d95841c4b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:27.182921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 523/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:27.188724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:27.289377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720aa94-98ae-4812-abc2-06316a610f5f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:27.322626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c7e0-1e5c-4dd9-85c5-00713571371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:27.323507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c7e0-1e5c-4dd9-85c5-00713571371c None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:27.323787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c7e0-1e5c-4dd9-85c5-00713571371c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:27.324056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c7e0-1e5c-4dd9-85c5-00713571371c None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:27.324731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c7e0-1e5c-4dd9-85c5-00713571371c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:27.326142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c7e0-1e5c-4dd9-85c5-00713571371c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:27.355198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 501/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:04:27 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:27.761954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78812f-a73c-4dc8-8975-3db66609f9df None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:27.762305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78812f-a73c-4dc8-8975-3db66609f9df None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:27.762510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78812f-a73c-4dc8-8975-3db66609f9df None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:27.764051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 524/1025] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:27.769749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225548b-3a55-4f82-bf9e-b071b88744a3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:27.770036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225548b-3a55-4f82-bf9e-b071b88744a3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:27.770309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225548b-3a55-4f82-bf9e-b071b88744a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:27.789293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6225548b-3a55-4f82-bf9e-b071b88744a3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:27.790469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6225548b-3a55-4f82-bf9e-b071b88744a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:27.836128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:27.866590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 502/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:27.890037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78812f-a73c-4dc8-8975-3db66609f9df None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:27.918034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:27.994273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78812f-a73c-4dc8-8975-3db66609f9df None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.028048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.028603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.028886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.029156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.039509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:28.043215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7825-a8c1-458b-8031-f8dcd0e7d5ce None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.043653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7825-a8c1-458b-8031-f8dcd0e7d5ce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.043838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7825-a8c1-458b-8031-f8dcd0e7d5ce None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:28.044502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:28.046193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:28.047525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:28.048178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 503/1027] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:28.054259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 525/1028] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 05:04:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:28.054403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.054403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.054403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.054793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.071119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:28.072520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:28.147173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.155570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 504/1029] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:28.160896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7b25-3ae9-4d4e-9822-b33aa1a9e994 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.177503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.197641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.198511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.198789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.199058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.199789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:28.200094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.201458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.210139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 526/1030] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:28.215679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.291919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99554bd-632c-47bf-9486-654af771c3ce None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.295033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.316096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede668-0a09-4f31-b31b-09eef9511eb5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.330896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.331562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.331837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.332109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] PATH_INFO: `/v3/services/image` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.332832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.334302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:28.343681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:28.344662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:28.345507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 505/1031] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:28.350943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.352710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.353378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.353644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.353923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.365095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.366568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:28.381423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:28.382513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:28.383685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:28.383685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:28.383685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:28.383685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:28.383685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 527/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:28.388037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.391286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.465445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d995704-1986-4607-9ef0-b80800eda360 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.502832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.503481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21358ea8-5400-424f-9ed0-cc8e75401af8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.503615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.503884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.504086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.504763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:28.505065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.506433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.511830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 506/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:28.518298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.547385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.547924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.548204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.548549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.549232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:28.549536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.550901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.554790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.568985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 528/1034] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:28.570572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.636185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.637881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d790cd-dbde-4a7a-a15d-99c09be60ce0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.672466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.673076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.673353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.673620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.674282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] RBAC: Adding query filter params (type=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:28.674582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.675967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.679648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172a8d-f2ce-4002-9bd2-a11963006310 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.680995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 507/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:28.687446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.715312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.716024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.716482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.716595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.724107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.725554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:28.737778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:28.738719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:28.740031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 529/1036] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:28.744714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.794756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.801957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a724c7-472b-46b2-9fae-dc09e141e4eb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.839620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.840342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.840622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.840889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.841637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] RBAC: Adding query filter params (interface=public, service_id=793d694b6e934393adcf83d38da7f92f, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:28.841929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.844152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.849271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87496720-1dad-4a4b-9ad5-5f5f093cbf38 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:28.849970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 508/1037] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/endpoints?service_id=793d694b6e934393adcf83d38da7f92f&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:28.855354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.874310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:28.886522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:28.887138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:28.887439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:28.887708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:28.888489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:28.888790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:28.890807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:28.910746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 530/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:28.916284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:28.971448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3516-ddd2-49d0-8a4f-6b339a323a4e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.008419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.009042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.009326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.009598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.010663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.012072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.031191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 509/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:04:29.036249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071fe99-3906-4ebb-a520-76982aaf9c58 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.075554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f6219-10ef-4931-b89a-6bf89ef0b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.076113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f6219-10ef-4931-b89a-6bf89ef0b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.076454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f6219-10ef-4931-b89a-6bf89ef0b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.076725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f6219-10ef-4931-b89a-6bf89ef0b8a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.131300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:29.154808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f6219-10ef-4931-b89a-6bf89ef0b8a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.156358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f6219-10ef-4931-b89a-6bf89ef0b8a7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.265305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 531/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 05:04:29.271540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.299595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:29.377815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8be8-9946-40d6-9484-084e0c5185fb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.411250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.411897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.412175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.412442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.423694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.425130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:29.439410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:29.440354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:29.441264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:29.441264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:29.441264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:29.441264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:29.444912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 510/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:29.445057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737b30-7b2c-4b7c-a7b5-643e6d2670c2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.445057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737b30-7b2c-4b7c-a7b5-643e6d2670c2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.445057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737b30-7b2c-4b7c-a7b5-643e6d2670c2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.446066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.446463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 532/1042] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:29.452269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.452548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.452826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.471236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:29.472420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:29.531183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:29.544283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 533/1043] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:29.557152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64c3a-79c3-4988-b7ec-1606ac2fc13e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.567836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.579999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:29.595542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.596107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.596386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.596663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.597501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:29.597608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.598964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.612842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 511/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:29.617877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.670315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25299c-cfc4-4b9b-b43e-d496a5a16b13 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.707883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.708520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.708795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.709064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.721175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:29.721789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d87bc-1d76-4616-a132-c68b6789abbc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:29.725988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:29.726951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:29.728500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 534/1045] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:29.732955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.765108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.766018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.766436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.766871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.769975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:29.775942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.777835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:29.790726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:29.791918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:29.792994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 512/1046] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:29.797917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.806894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:29.842565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7e6a-1088-4b39-8d8c-6a9a320e1871 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.879090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.879963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.880240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.880512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.881220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:29.881518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.882896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.892290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 535/1047] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:29.897773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:29.916504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5164-1f02-48c8-9283-ed25d9ad59b8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:29.955396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08d428-678b-4711-a726-278ca040543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:29.955941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08d428-678b-4711-a726-278ca040543c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:29.956213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08d428-678b-4711-a726-278ca040543c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:29.956486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08d428-678b-4711-a726-278ca040543c None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:29.957218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08d428-678b-4711-a726-278ca040543c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:29.957539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08d428-678b-4711-a726-278ca040543c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:29.959031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08d428-678b-4711-a726-278ca040543c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:29.977054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 513/1048] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:29.978766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08d428-678b-4711-a726-278ca040543c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:30.003032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb67c0-228c-420a-b25b-2a32a8592a07 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:30.033508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:30.039304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:30.039812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:30.040766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:30.041109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:30.041440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] PATH_INFO: `/v3/users/41664e5b2a994ad0b3e8d389abe782e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:30.055900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] RBAC: Authorizing `identity:get_user(user_id=41664e5b2a994ad0b3e8d389abe782e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:30.057338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:30.058993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 536/1049] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/users/41664e5b2a994ad0b3e8d389abe782e4 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:30.065204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:30.097613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08d428-678b-4711-a726-278ca040543c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:30.137180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:30.137792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:30.138068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:30.138335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:30.139115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] RBAC: Adding query filter params (role.id=f550db3e8ba9469aa0b87bb6577a5468, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=097e3f30073e48ec832b53d8f89d0d16) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:30.140522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:30.141960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:30.147800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 514/1050] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:29 2022] GET /identity/v3/role_assignments?user.id=097e3f30073e48ec832b53d8f89d0d16&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=f550db3e8ba9469aa0b87bb6577a5468 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:30.187364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763227-587b-403a-91dd-7c3705214a09 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:30.226362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:30.226896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:30.227205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:30.227467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:30.290352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:30.303376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:30.304828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:30.407095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 537/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 05:04:30.412630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:30.516294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adef699-ed64-4191-9d8f-24ef7fc8be8b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:30.536969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:30.552765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b771-7dfa-4204-bf3e-8d65cbad0237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:30.553401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b771-7dfa-4204-bf3e-8d65cbad0237 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:30.553677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b771-7dfa-4204-bf3e-8d65cbad0237 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:30.553947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b771-7dfa-4204-bf3e-8d65cbad0237 None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:30.555074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b771-7dfa-4204-bf3e-8d65cbad0237 None admin] RBAC: Authorizing `identity:get_project(project_id=990b025e986a49d4b056a4b133d6c884)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:30.556501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b771-7dfa-4204-bf3e-8d65cbad0237 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:30.558333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 515/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:30 2022] GET /identity/v3/projects/990b025e986a49d4b056a4b133d6c884 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:30.564241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:30.676271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:30.687892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7566dd-9fe3-484b-a4aa-177d2c7c1080 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:30.723027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:30.723835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:30.724119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:30.724390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:30.725167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=990b025e986a49d4b056a4b133d6c884, user.id=41664e5b2a994ad0b3e8d389abe782e4) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:30.725471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:30.726893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be057ac-4660-4d24-8166-b26066c51b76 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:30.739178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 538/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:30 2022] GET /identity/v3/role_assignments?user.id=41664e5b2a994ad0b3e8d389abe782e4&scope.project.id=990b025e986a49d4b056a4b133d6c884&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:31.074599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd727b-9624-45e5-8bbb-f104c42352fc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:31.074984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd727b-9624-45e5-8bbb-f104c42352fc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:31.075193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd727b-9624-45e5-8bbb-f104c42352fc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:31.076571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 516/1054] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:31.082435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:31.082902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:31.082983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:31.101274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:31.102433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:31.180888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 539/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:31.202665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd727b-9624-45e5-8bbb-f104c42352fc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:31.309208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd727b-9624-45e5-8bbb-f104c42352fc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:31.344000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:31.344555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:31.344833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:31.345100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:31.345709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:31.347139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:31.359883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:31.360921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:31.361776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 517/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 5 05:04:31 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:31.367004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:31.454495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:31.471323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baeb7-7140-473c-a93a-154b7a5abcd9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:31.504599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:31.505203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:31.505480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:31.505750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:31.506410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:31.506709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:31.508096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:31.518069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 540/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:31.519021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:31.572709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:31.623277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b73358-f4ea-4d7f-8095-39b90d3008e1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:31.657377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:31.657992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:31.658275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:31.658549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:31.659243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] RBAC: Adding query filter params (type=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:31.659558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:31.660919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292160-969c-40dc-9808-eeba64783e82 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:31.670380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 518/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:31.672161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:31.772016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d69845-ff36-41fe-a831-c251e1f27da4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:31.806809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d3700-a00f-425f-9b09-5aef3c430068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:31.807456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d3700-a00f-425f-9b09-5aef3c430068 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:31.807738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d3700-a00f-425f-9b09-5aef3c430068 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:31.808011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d3700-a00f-425f-9b09-5aef3c430068 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:31.808713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d3700-a00f-425f-9b09-5aef3c430068 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:31.810159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d3700-a00f-425f-9b09-5aef3c430068 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:31.843200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 541/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:04:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:32.181612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e917a0-c4c0-4809-8d2e-faaa8a29b51c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.181906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e917a0-c4c0-4809-8d2e-faaa8a29b51c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.182183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e917a0-c4c0-4809-8d2e-faaa8a29b51c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.183734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 519/1060] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:32.189207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.189624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.189800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.196991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:32.210054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:32.211265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:32.287253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 542/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:32.308609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e917a0-c4c0-4809-8d2e-faaa8a29b51c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:32.414490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e917a0-c4c0-4809-8d2e-faaa8a29b51c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:32.431008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:32.450230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:32.450862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.451142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.451441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.462654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:32.468204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:32.469141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:32.469989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:32.471259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 520/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 05:04:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:32.475285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:32.574694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5f4de-46e9-4d66-9ed6-6cd68a97af1e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:32.605114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:32.611794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:32.612639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.613204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.613655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.614543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:32.615025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:32.616646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1757ac5-f33c-475f-96ea-c6459394a104 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:32.630454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 543/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:04:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:32.631901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:32.731795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3824f2c-bb7e-472f-9b8e-15052bbe150e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.732345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3824f2c-bb7e-472f-9b8e-15052bbe150e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.732805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3824f2c-bb7e-472f-9b8e-15052bbe150e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.734460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 544/1064] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:32.735358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3525df-70fc-46f2-b6e0-25f35dfda95a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:32.739353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.739702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.740048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.759348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:32.760523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:32.773385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:32.774226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.774360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.774713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.787773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:32.789194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:32.804676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:32.805594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:32.806487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:32.806487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:32.806487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:32.806487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:32.807129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 521/1065] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:32.812479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:32.839236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 545/1066] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:32.846657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:32.860318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:32.926858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936091a-e32c-4482-b62f-f60c94919769 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:32.962538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:32.963148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:32.963462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:32.963734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:32.964408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:32.964706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:32.966052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:32.970801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6172-c263-4178-a080-31d34bc15625 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:32.978817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 522/1067] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:32.985474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.003212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.018111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.019114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.019641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.020090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.033344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:33.038735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:33.039734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:33.040582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 546/1068] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:33.046637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.080716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.094240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6127e-fe40-4e11-81cf-7a215c405eef None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.131218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.131887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.132172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.132447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.140726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.142166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.151989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9ce3-8b5d-479e-a716-c0da6ca04ac9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:33.153840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:33.155103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:33.156860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 523/1069] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:04:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:33.161731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.203468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.204079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.204358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.204628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.205340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:33.205645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.207145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.216021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 547/1070] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:33.221884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.267928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.277794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b2ad8-4328-4342-8e99-0c0bd7501beb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.315180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.316181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.316628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.317047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.318089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:33.318661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.320101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.324490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe446-995f-489e-970c-7bc16d5cab17 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.344457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 524/1071] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:33.345547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.354079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.365497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.366138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.366420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.366694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] PATH_INFO: `/v3/users/41664e5b2a994ad0b3e8d389abe782e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.367874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] RBAC: Authorizing `identity:get_user(user_id=41664e5b2a994ad0b3e8d389abe782e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.369303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.370905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 548/1072] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/users/41664e5b2a994ad0b3e8d389abe782e4 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:33.377099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.457839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ffcc-cc24-4233-9905-20d600bd0b47 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.486096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c66b-f70f-458e-a386-dcfc5215ff68 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.495028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.496035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.496511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.497075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.500452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.509470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.510918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.523127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.523726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.524007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.524283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.525429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] RBAC: Authorizing `identity:get_project(project_id=990b025e986a49d4b056a4b133d6c884)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.526860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:33.527021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:33.527965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:33.535023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:33.535023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:33.535023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:33.535023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:33.535023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 525/1073] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:33.535358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 549/1074] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/projects/990b025e986a49d4b056a4b133d6c884 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:33.535445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.535519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.598539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.641416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a0923-edfe-4adf-abd2-962b0712b99c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.643870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a663-0fde-488d-b893-b838f42e4587 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.677402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.678080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.678370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.678649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884/users/41664e5b2a994ad0b3e8d389abe782e4/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.680415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.680613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] RBAC: Authorizing `identity:create_grant(project_id=990b025e986a49d4b056a4b133d6c884, user_id=41664e5b2a994ad0b3e8d389abe782e4, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.681034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.681312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.681582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.682047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.682264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:33.682570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.683945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.697149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 526/1075] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:33.699090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 550/1076] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:04:33 2022] PUT /identity/v3/projects/990b025e986a49d4b056a4b133d6c884/users/41664e5b2a994ad0b3e8d389abe782e4/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:04:33.702943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.816277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28b8e3-faca-4b86-b5fa-1a77ed4cb5f5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:33.836297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.858603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:33.859395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.859677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.859949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.871095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:33.871095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-42441ef2-0841-45a5-abda-7fa574030913 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:33.883748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:33.884938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:33.886187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 527/1077] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:33.890790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:33.918473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075f9d7-89ec-4219-8de1-c64294b400df None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.918751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075f9d7-89ec-4219-8de1-c64294b400df None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.919022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075f9d7-89ec-4219-8de1-c64294b400df None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.920891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 528/1078] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:04:33.926889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:33.927194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:33.927473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:33.939318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:33.947987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:33.949716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:34.000111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c480-e0fa-49a7-930d-e2d1ec5efd32 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:34.031943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 529/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:34.035230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45968666-2926-49ce-8c07-49628240757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:34.036048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968666-2926-49ce-8c07-49628240757a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:34.036323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968666-2926-49ce-8c07-49628240757a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:34.036592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968666-2926-49ce-8c07-49628240757a None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:34.037383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45968666-2926-49ce-8c07-49628240757a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:34.037691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45968666-2926-49ce-8c07-49628240757a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:34.039121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45968666-2926-49ce-8c07-49628240757a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:34.052458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 551/1080] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:34.053947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:34.058240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45968666-2926-49ce-8c07-49628240757a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:34.157816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3dad8-66cb-493a-ac75-559de2cc26db None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:34.159789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:34.163437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45968666-2926-49ce-8c07-49628240757a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:34.172779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:34.203097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:34.203764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:34.204040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:34.204347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:34.205526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:34.206198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:34.206481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:34.206889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/097e3f30073e48ec832b53d8f89d0d16/roles/f550db3e8ba9469aa0b87bb6577a5468` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:34.209003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=097e3f30073e48ec832b53d8f89d0d16, role_id=f550db3e8ba9469aa0b87bb6577a5468)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:34.210447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:34.227230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 552/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:04:34 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/097e3f30073e48ec832b53d8f89d0d16/roles/f550db3e8ba9469aa0b87bb6577a5468 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:04:34.281273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:34.282763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:34.395149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 530/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:34.400846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:34.504244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad761dc-266a-455d-b776-c23f42bbf451 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:34.538236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:34.538870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:34.539146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:34.539437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:34.549629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:34.551190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6b263daf-7fc6-40a8-ab1a-2e13239ec719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:34.565609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:34.566495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:34.567828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:34.567828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:34.567828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:34.567828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:34.571219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 553/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:34.572980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:34.584554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:34.676674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157571-e851-424b-a3c0-b03c4ea4ab14 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:34.711088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:34.711725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:34.712007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:34.712278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:34.712952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:34.713252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:34.714607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49794-7b09-4b5c-8c00-67d11ce1d624 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:34.733743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 531/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:35.829146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79ffd2-ca35-4751-a0e0-9b4cf6e4038a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:35.829718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79ffd2-ca35-4751-a0e0-9b4cf6e4038a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:35.829815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79ffd2-ca35-4751-a0e0-9b4cf6e4038a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:35.831714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 554/1085] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:35.837732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:35.838164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:35.838275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:35.856891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:35.858253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:35.920730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:35.926429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 532/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:35.950658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79ffd2-ca35-4751-a0e0-9b4cf6e4038a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:35.966648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.052350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79ffd2-ca35-4751-a0e0-9b4cf6e4038a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.085726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305d334-6ccb-4dec-88de-2802480d97e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.086284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305d334-6ccb-4dec-88de-2802480d97e6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.086561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305d334-6ccb-4dec-88de-2802480d97e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.086830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305d334-6ccb-4dec-88de-2802480d97e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.097263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305d334-6ccb-4dec-88de-2802480d97e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e305d334-6ccb-4dec-88de-2802480d97e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:36.102104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:36.108419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:36.109513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 555/1087] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:36.110558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.210736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204489b-f081-437f-bdaf-454e36df72d9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.244243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.244850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.245131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.245418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.246113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:36.246413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.247792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:36.255837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 533/1088] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:36.260689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561befb-8fea-4c41-9580-00fc3260aa2e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.260972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561befb-8fea-4c41-9580-00fc3260aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.261249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561befb-8fea-4c41-9580-00fc3260aa2e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.261525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.262572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 556/1089] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:36.268082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.268364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.268633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.286619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:36.287827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:36.320349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.355272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 557/1090] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:36.366693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53aa7-264c-4059-9458-fb0545ca80e2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.378509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.380966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.401175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.401806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.402083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.402353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] PATH_INFO: `/v3/users/41664e5b2a994ad0b3e8d389abe782e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.403521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] RBAC: Authorizing `identity:get_user(user_id=41664e5b2a994ad0b3e8d389abe782e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.404962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:36.406577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 534/1091] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/users/41664e5b2a994ad0b3e8d389abe782e4 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:36.412348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.480455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d934-6615-4b25-b4a9-b40db4a08edb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.511009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c93c9-c74c-41f8-8971-27db87f0b922 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.513642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.514380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.514663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.514935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.525242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:36.530679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:36.531676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:36.532526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 558/1092] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:36.538208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.540323 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.553445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.554064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.554345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.554618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.598829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.622419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.624420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:36.638906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc062c2-f0e0-4db0-aadf-741529af79d1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.671953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.672556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.672833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.673104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.673807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:36.674114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.675509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:36.683141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 559/1093] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:36.689880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.721972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 535/1094] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 05:04:36.727738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.754630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.788755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3828-1d86-42f5-8cf4-b79a7e933182 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.811561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.822551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.823460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.823736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.824002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.828111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b2ef9-b90f-449c-bdd9-f5ec202787a1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.834629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.836097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:36.850562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:36.851534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:36.852793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:36.852793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:36.852793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:36.852793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:36.852793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 560/1095] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:36.857339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.864811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.865442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.865717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.865986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.867112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] RBAC: Authorizing `identity:get_project(project_id=990b025e986a49d4b056a4b133d6c884)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.868542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:36.870181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 536/1096] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/projects/990b025e986a49d4b056a4b133d6c884 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:36.877082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:36.957126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9f693-b6c9-4520-87e3-a0a7a5e094b5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.969483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:36.975383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7670f7c-d843-4893-90cc-799c52c6c839 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:36.990878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:36.991518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:36.991807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:36.992082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:36.992762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:36.993066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:36.994445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.005732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 561/1097] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:37.010430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:37.011017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:37.011310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:37.011409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:37.011586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:37.012366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=990b025e986a49d4b056a4b133d6c884, user.id=41664e5b2a994ad0b3e8d389abe782e4) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:37.012673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:37.014603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.021113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 537/1098] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:36 2022] GET /identity/v3/role_assignments?user.id=41664e5b2a994ad0b3e8d389abe782e4&scope.project.id=990b025e986a49d4b056a4b133d6c884&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:37.048177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:37.117735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d1fd3-bec7-48a8-8280-6bf7e566c8d9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:37.155245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:37.155910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:37.156192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:37.156463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:37.164997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:37.166190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:04:37.180071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:37.181224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 05:04:37.182482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:37.183347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 562/1099] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 05:04:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:04:37.187499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:37.291377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801058a-5fc0-490d-80bf-da0a58d17602 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:37.325971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:37.327021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:37.327343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:37.327620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:37.328401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:37.328705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:37.330113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.348378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 538/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 05:04:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:04:37.354111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:37.452627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:37.458919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afffa-33e3-4fd6-8c55-356d5c3b0168 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:37.492121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:37.492731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:37.493010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:37.493280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:37.558027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:37.559506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.649620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:37.660977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 563/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:37.662239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:37.683726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:37.773288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b2da3-ceac-40e0-953c-82285b1aa8d8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:37.812494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:37.813127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:37.813408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:37.813679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:37.824022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:37.825450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:04:37.840643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:37.841604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:37.843090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:04:37.843090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:04:37.843090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:04:37.843090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:37.843090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 539/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:37.847573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:37.945960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8f017-1c40-4eec-b75b-46b427791b96 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:37.979777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:37.980383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:37.980661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:37.980934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:37.981610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:37.981916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:37.983885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:37.994736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 564/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:38.000484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:38.068999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:38.100712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16038e46-f525-4105-b5ce-a5824acdad9b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:38.135176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:38.135816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:38.136096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:38.136366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:38.142959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:38.144418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:04:38.156067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:38.157145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:04:38.158058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 540/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:38.163111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:38.220509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:38.263706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49585ff-1e0f-4b80-bd1d-f6383aeea40e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:38.296694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:38.297296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:38.297568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:38.297832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:38.298558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:38.298857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:38.300318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964376f5-d154-45e0-bc62-935038093f92 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:38.312032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 565/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:38.318190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:38.415310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0a55-8ce1-4b96-bb69-439745a80c50 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:38.443356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:38.449784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:38.450382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:38.450659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:38.450926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:38.452329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] RBAC: Adding query filter params (role.id=f550db3e8ba9469aa0b87bb6577a5468, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=097e3f30073e48ec832b53d8f89d0d16) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:38.452632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:38.454040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df9990-bdcd-47ac-91a5-eeac56604ee0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:38.459692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 541/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:38 2022] GET /identity/v3/role_assignments?user.id=097e3f30073e48ec832b53d8f89d0d16&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=f550db3e8ba9469aa0b87bb6577a5468 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:39.094032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e37d8-f67c-4970-b7da-6214cdb7f571 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:39.094578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e37d8-f67c-4970-b7da-6214cdb7f571 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:39.094578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e37d8-f67c-4970-b7da-6214cdb7f571 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:39.095969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 566/1107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:39.101226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:39.101622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:39.101771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:39.121164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:39.122323 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:39.195606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 542/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:39.220786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e37d8-f67c-4970-b7da-6214cdb7f571 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:39.331137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e37d8-f67c-4970-b7da-6214cdb7f571 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:39.346974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:39.364928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20761f84-2ef3-44d1-be62-60ca58078066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:39.365584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761f84-2ef3-44d1-be62-60ca58078066 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:39.365865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761f84-2ef3-44d1-be62-60ca58078066 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:39.366137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761f84-2ef3-44d1-be62-60ca58078066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:39.367300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20761f84-2ef3-44d1-be62-60ca58078066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:39.368748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20761f84-2ef3-44d1-be62-60ca58078066 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:39.370315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 567/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:39.376859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:39.474814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810f8e-9228-4b18-a871-ded4d84581b2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:39.498151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:39.509274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aaa83-5108-4c41-9800-085d0bc234b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:39.509878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aaa83-5108-4c41-9800-085d0bc234b7 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:39.510158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aaa83-5108-4c41-9800-085d0bc234b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:39.510426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aaa83-5108-4c41-9800-085d0bc234b7 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:39.511104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aaa83-5108-4c41-9800-085d0bc234b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:39.512546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aaa83-5108-4c41-9800-085d0bc234b7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:39.533435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 543/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:04:39 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:04:41.563246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb01114-bf0b-42a5-87fe-6c72852f5e8f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:41.563769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb01114-bf0b-42a5-87fe-6c72852f5e8f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:41.563769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb01114-bf0b-42a5-87fe-6c72852f5e8f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:41.565032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 568/1111] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:41.570111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:41.570478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:41.570656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:41.589345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:41.590512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:41.654275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 544/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:41.676855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb01114-bf0b-42a5-87fe-6c72852f5e8f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:41.775129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb01114-bf0b-42a5-87fe-6c72852f5e8f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:41.808180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:41.808803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:41.809079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:41.809349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] PATH_INFO: `/v3/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:41.811313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] RBAC: Authorizing `identity:get_role(role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:41.812861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:41.814234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 569/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:41 2022] GET /identity/v3/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:41.820011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:41.918213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe6e9-3863-4c82-a7de-45344c5013fd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:41.928667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:41.953974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:41.954598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:41.954879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:41.955170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] PATH_INFO: `/v3/users/801cc054353644649f2a87bae87da7bb` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:41.967918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] RBAC: Authorizing `identity:get_user(user_id=801cc054353644649f2a87bae87da7bb)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:41.969347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:41.970951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 545/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:41 2022] GET /identity/v3/users/801cc054353644649f2a87bae87da7bb => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:41.976703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:42.027162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:42.071802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039689e-a969-4e0f-8978-b687e8f5cef8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:42.103697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:42.104291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:42.104569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:42.104840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:42.169891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:42.170854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:42.219824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:42.265637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 570/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:42.271508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:42.368033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a1b36-bf66-4c0c-bcf5-d19d756310ec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:42.401165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201223-9a9c-4a69-8d18-ccd4626434c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:42.401778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201223-9a9c-4a69-8d18-ccd4626434c8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:42.402055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201223-9a9c-4a69-8d18-ccd4626434c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:42.402324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201223-9a9c-4a69-8d18-ccd4626434c8 None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:42.403459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da201223-9a9c-4a69-8d18-ccd4626434c8 None admin] RBAC: Authorizing `identity:get_project(project_id=990b025e986a49d4b056a4b133d6c884)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:42.405067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da201223-9a9c-4a69-8d18-ccd4626434c8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:42.406678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 546/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:42 2022] GET /identity/v3/projects/990b025e986a49d4b056a4b133d6c884 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:42.412622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:42.506379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe98ad9-a2d5-484d-aeb9-a290bc607c3c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:42.538668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:42.539288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:42.539565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:42.539831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:42.540591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] RBAC: Adding query filter params (role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=990b025e986a49d4b056a4b133d6c884, user.id=801cc054353644649f2a87bae87da7bb) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:42.540891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:42.542335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459f98-f88c-472b-8200-15cfcbefebfd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:42.547634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 571/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:42 2022] GET /identity/v3/role_assignments?user.id=801cc054353644649f2a87bae87da7bb&scope.project.id=990b025e986a49d4b056a4b133d6c884&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:44.511082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9a46a-e318-4be9-be67-f2edd582e5dd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:44.511625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9a46a-e318-4be9-be67-f2edd582e5dd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:44.511625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9a46a-e318-4be9-be67-f2edd582e5dd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:44.512927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 547/1118] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:44.518742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:44.519189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:44.519337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:44.537422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:44.538602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:44.549480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:44.605414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 572/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:44.627832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9a46a-e318-4be9-be67-f2edd582e5dd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:44.663128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:44.726135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9a46a-e318-4be9-be67-f2edd582e5dd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:44.758841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:44.759484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:44.759764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:44.760032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] PATH_INFO: `/v3/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:44.761486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] RBAC: Authorizing `identity:get_role(role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:44.762777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:44.764254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 548/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:44 2022] GET /identity/v3/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:44.769993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:44.864039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26285f-410c-4dd9-be59-ee07cecc2637 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:44.895505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:44.896117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:44.896393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:44.896661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] PATH_INFO: `/v3/users/801cc054353644649f2a87bae87da7bb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:44.897778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] RBAC: Authorizing `identity:get_user(user_id=801cc054353644649f2a87bae87da7bb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:44.899215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:44.900762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 573/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:44 2022] GET /identity/v3/users/801cc054353644649f2a87bae87da7bb => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:44.906924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:45.004924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9c200-cac1-4f60-a896-111a25c5f0de None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:45.007185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:45.039001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59112-8a11-4ea7-af75-eefff763a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:45.039595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59112-8a11-4ea7-af75-eefff763a0ee None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:45.039876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59112-8a11-4ea7-af75-eefff763a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:45.040150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59112-8a11-4ea7-af75-eefff763a0ee None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:45.041286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59112-8a11-4ea7-af75-eefff763a0ee None admin] RBAC: Authorizing `identity:get_project(project_id=990b025e986a49d4b056a4b133d6c884)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:45.042699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59112-8a11-4ea7-af75-eefff763a0ee None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:45.044356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 549/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:44 2022] GET /identity/v3/projects/990b025e986a49d4b056a4b133d6c884 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:45.050308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:45.065532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:45.147385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3725e74-016a-4606-baec-18dda93a894c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:45.180725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f678768-bc8f-4d58-b641-fa41bb9152ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:45.181386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678768-bc8f-4d58-b641-fa41bb9152ba None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:45.181667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678768-bc8f-4d58-b641-fa41bb9152ba None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:45.181942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678768-bc8f-4d58-b641-fa41bb9152ba None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884/users/801cc054353644649f2a87bae87da7bb/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:45.184113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678768-bc8f-4d58-b641-fa41bb9152ba None admin] RBAC: Authorizing `identity:create_grant(project_id=990b025e986a49d4b056a4b133d6c884, user_id=801cc054353644649f2a87bae87da7bb, role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:45.185582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678768-bc8f-4d58-b641-fa41bb9152ba None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:45.197707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 574/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:04:45 2022] PUT /identity/v3/projects/990b025e986a49d4b056a4b133d6c884/users/801cc054353644649f2a87bae87da7bb/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:04:47.179810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f4ff-c59e-4329-ac9f-7ab75ca765e5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:47.180261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f4ff-c59e-4329-ac9f-7ab75ca765e5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:47.180365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f4ff-c59e-4329-ac9f-7ab75ca765e5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:47.181706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 550/1124] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:47.187144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:47.187598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:47.187701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:47.206187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:47.207388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:47.272160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 575/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:47.299494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627f4ff-c59e-4329-ac9f-7ab75ca765e5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:47.400821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627f4ff-c59e-4329-ac9f-7ab75ca765e5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:47.434145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:47.434709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:47.434989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:47.435303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] PATH_INFO: `/v3/roles/ee9afbaa462e47d4867da4fba788ef24` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:47.436850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] RBAC: Authorizing `identity:get_role(role_id=ee9afbaa462e47d4867da4fba788ef24)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:47.438202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:47.439554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 551/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:47 2022] GET /identity/v3/roles/ee9afbaa462e47d4867da4fba788ef24 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:47.445514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:47.448882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:47.541488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be9c16-ed8b-4a38-a6c3-fcb742b0aa75 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:47.573657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:47.574277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:47.574555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:47.574825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] PATH_INFO: `/v3/users/801cc054353644649f2a87bae87da7bb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:47.576509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] RBAC: Authorizing `identity:get_user(user_id=801cc054353644649f2a87bae87da7bb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:47.577934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:47.579528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 576/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:47 2022] GET /identity/v3/users/801cc054353644649f2a87bae87da7bb => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:47.585242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:47.627334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:47.684888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6852c94-f397-490c-8535-4883113226c8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:47.718854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:47.719481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:47.719763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:47.720030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:47.784354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:47.785775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:47.824079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:47.880784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 552/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:47.886724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:47.955983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:47.986241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddf299-14c9-47bd-9bcb-1b98795b6dcc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:48.019070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5c14-ac7e-4161-96ed-ff20451d95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:48.019730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5c14-ac7e-4161-96ed-ff20451d95c0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:48.020014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5c14-ac7e-4161-96ed-ff20451d95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:48.020286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5c14-ac7e-4161-96ed-ff20451d95c0 None admin] PATH_INFO: `/v3/projects/990b025e986a49d4b056a4b133d6c884` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:48.021420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5c14-ac7e-4161-96ed-ff20451d95c0 None admin] RBAC: Authorizing `identity:get_project(project_id=990b025e986a49d4b056a4b133d6c884)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:48.022863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5c14-ac7e-4161-96ed-ff20451d95c0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:48.024541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 577/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:47 2022] GET /identity/v3/projects/990b025e986a49d4b056a4b133d6c884 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:48.031460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:48.126892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ad7af-205d-4d54-a201-b91281a8e42c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:48.159768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:48.160362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:48.160637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:48.160902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:48.161688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] RBAC: Adding query filter params (role.id=ee9afbaa462e47d4867da4fba788ef24, scope.project.id=990b025e986a49d4b056a4b133d6c884, user.id=801cc054353644649f2a87bae87da7bb) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:48.161993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:48.163871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30851fd-cb4e-4e8c-9250-4faf482eff60 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:48.169872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 553/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:48 2022] GET /identity/v3/role_assignments?user.id=801cc054353644649f2a87bae87da7bb&scope.project.id=990b025e986a49d4b056a4b133d6c884&role.id=ee9afbaa462e47d4867da4fba788ef24 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:50.154664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2b68-7d36-41b2-9aa8-2591d8611519 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:50.155244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2b68-7d36-41b2-9aa8-2591d8611519 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:50.155244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2b68-7d36-41b2-9aa8-2591d8611519 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:50.156572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 578/1131] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:50.161909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:50.162325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:50.162573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:50.169997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:50.181164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:50.182329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:50.246672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 554/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:04:50.269828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2b68-7d36-41b2-9aa8-2591d8611519 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:50.368435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2b68-7d36-41b2-9aa8-2591d8611519 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:50.401495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db22d3-363a-4e6d-bfc0-0084364bc635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:50.402113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db22d3-363a-4e6d-bfc0-0084364bc635 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:50.402391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db22d3-363a-4e6d-bfc0-0084364bc635 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:50.402660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db22d3-363a-4e6d-bfc0-0084364bc635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:50.403784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db22d3-363a-4e6d-bfc0-0084364bc635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:50.405634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db22d3-363a-4e6d-bfc0-0084364bc635 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:50.407137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 579/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:50.412933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:50.508647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbd757-d0e5-4750-b3bf-4a9e6b91ecfd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:50.541463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364007-495a-4e01-bcbf-12daa249db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:50.542055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364007-495a-4e01-bcbf-12daa249db2e None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:50.542332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364007-495a-4e01-bcbf-12daa249db2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:50.542599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364007-495a-4e01-bcbf-12daa249db2e None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:50.543283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364007-495a-4e01-bcbf-12daa249db2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:50.544990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364007-495a-4e01-bcbf-12daa249db2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:50.549448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:50.571977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 555/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:04:50 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:52.586082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672a9a-863f-41e1-a40e-c73095e98e17 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:52.586594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672a9a-863f-41e1-a40e-c73095e98e17 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:52.586594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672a9a-863f-41e1-a40e-c73095e98e17 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:52.587893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 580/1135] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:52.593800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:52.594169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:52.594344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:52.611944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:52.613104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:52.678410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 556/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:52.703262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672a9a-863f-41e1-a40e-c73095e98e17 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:52.713783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:52.803320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672a9a-863f-41e1-a40e-c73095e98e17 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:52.835912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5c677-dd58-434b-b238-2967c5e951af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:52.836580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c677-dd58-434b-b238-2967c5e951af None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:52.836810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c677-dd58-434b-b238-2967c5e951af None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:52.837082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c677-dd58-434b-b238-2967c5e951af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:52.838198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5c677-dd58-434b-b238-2967c5e951af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:52.839653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5c677-dd58-434b-b238-2967c5e951af None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:52.841210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 581/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:04:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:52.847781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:52.944657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00722d-dbc5-4c9f-a8f2-7b05dac393e9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:52.961499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:52.979570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea237a-bbbf-4b19-8102-1723ff5e6bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:52.980167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea237a-bbbf-4b19-8102-1723ff5e6bdf None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:52.980442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea237a-bbbf-4b19-8102-1723ff5e6bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:52.980712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea237a-bbbf-4b19-8102-1723ff5e6bdf None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:52.981384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea237a-bbbf-4b19-8102-1723ff5e6bdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:52.982946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea237a-bbbf-4b19-8102-1723ff5e6bdf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:53.003046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 557/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:04:52 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:04:55.025429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b7fc-bb89-44de-ad69-159ffacfe266 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:55.025975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b7fc-bb89-44de-ad69-159ffacfe266 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:55.025975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b7fc-bb89-44de-ad69-159ffacfe266 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:55.027321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 582/1139] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:55.032642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:55.033078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:55.033215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:55.051555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:55.052729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:55.119071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 558/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:55.142146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872b7fc-bb89-44de-ad69-159ffacfe266 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:55.217661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:55.241490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872b7fc-bb89-44de-ad69-159ffacfe266 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:55.273726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:55.274355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:55.274995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:55.274995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:55.285292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:55.290090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:55.291319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:55.292429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 583/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:55.297804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:55.396808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bf95-410c-4ae6-bd1e-e08e6b3f057d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:55.398320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:55.432781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:55.433387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:55.433667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:55.433939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:55.434647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:55.434979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:55.436373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:55.444206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 559/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:55.450246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:55.546791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727640d9-a184-4f55-a223-3bc793a063d3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:55.579415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:55.580035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:55.580316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:55.580590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] PATH_INFO: `/v3/users/290e1d4811a74e9d9ae7408911476810` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:55.583181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:55.593741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] RBAC: Authorizing `identity:get_user(user_id=290e1d4811a74e9d9ae7408911476810)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:55.595214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:55.596835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 584/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:55 2022] GET /identity/v3/users/290e1d4811a74e9d9ae7408911476810 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:55.602558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:55.701445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075938-76c1-4902-869b-a16809c925c6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:55.734327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:55.734925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:55.735230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:55.735506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:55.765459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:55.801772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:55.803136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:55.896370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 560/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:04:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:04:55.902201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:55.998204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2fcc6-afcc-4b9a-88f9-d9d842980a54 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:56.030057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc06f-4903-40f1-8650-5b14e91d2540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:56.030904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc06f-4903-40f1-8650-5b14e91d2540 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:56.030904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc06f-4903-40f1-8650-5b14e91d2540 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:56.031206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc06f-4903-40f1-8650-5b14e91d2540 None admin] PATH_INFO: `/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:56.032332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc06f-4903-40f1-8650-5b14e91d2540 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8a93aae3f44d1aa9aa35ef43cec876)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:56.033747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc06f-4903-40f1-8650-5b14e91d2540 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:56.035405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 585/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:55 2022] GET /identity/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:56.041575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:56.102053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:56.138858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3d212-9190-4bd9-ba71-53c724c936d9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:56.173413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:56.174022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:56.174303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:56.174574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:56.175407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=5e8a93aae3f44d1aa9aa35ef43cec876, user.id=290e1d4811a74e9d9ae7408911476810) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:56.175715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:56.177119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be249f9e-0875-4bb9-9b84-2c2cac121dd8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:56.182429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 561/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:04:56 2022] GET /identity/v3/role_assignments?user.id=290e1d4811a74e9d9ae7408911476810&scope.project.id=5e8a93aae3f44d1aa9aa35ef43cec876&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:58.142084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877654-27df-4db5-b69f-7d653415fbd1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.142633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877654-27df-4db5-b69f-7d653415fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.142633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877654-27df-4db5-b69f-7d653415fbd1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.143981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 586/1147] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:04:58.149127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.149573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.149677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.168195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:04:58.170022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:04:58.235457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 562/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:04:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:04:58.257089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877654-27df-4db5-b69f-7d653415fbd1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:58.317717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:58.356442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877654-27df-4db5-b69f-7d653415fbd1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:58.391222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:58.391842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.392172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.392397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.402152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:04:58.407644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:04:58.408778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:04:58.410020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 587/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:04:58.414741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:58.472768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:58.514898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09975f-6693-44ac-bca0-b7dee1b17afe None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:58.548317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:58.548927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.549208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.549484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.550186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:04:58.550490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:58.551870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:58.559751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 563/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:04:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:58.565824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:58.661600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207a7b0-4eb9-4c85-aed1-d458e7e331bc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:58.682012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:58.693403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:58.694019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.694294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.694560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] PATH_INFO: `/v3/users/290e1d4811a74e9d9ae7408911476810` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.695708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] RBAC: Authorizing `identity:get_user(user_id=290e1d4811a74e9d9ae7408911476810)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:58.697139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:58.698937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 588/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:04:58 2022] GET /identity/v3/users/290e1d4811a74e9d9ae7408911476810 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:58.705289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:58.801932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95010-316e-429f-91cc-4695e99eb746 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:58.821021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:04:58.835820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec8294-de16-41c6-a4cc-beede97405eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:58.836439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8294-de16-41c6-a4cc-beede97405eb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.836718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8294-de16-41c6-a4cc-beede97405eb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.836990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8294-de16-41c6-a4cc-beede97405eb None admin] PATH_INFO: `/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.838124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec8294-de16-41c6-a4cc-beede97405eb None admin] RBAC: Authorizing `identity:get_project(project_id=5e8a93aae3f44d1aa9aa35ef43cec876)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:58.839572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec8294-de16-41c6-a4cc-beede97405eb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:58.841333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 564/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:04:58 2022] GET /identity/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:04:58.847312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:04:58.942868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec1e48-e7bb-4f38-90c1-2582f0247496 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:04:58.974928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5442f-aaa2-4828-86e6-c61a7617c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:04:58.975603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5442f-aaa2-4828-86e6-c61a7617c455 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:04:58.975882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5442f-aaa2-4828-86e6-c61a7617c455 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:04:58.976153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5442f-aaa2-4828-86e6-c61a7617c455 None admin] PATH_INFO: `/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876/users/290e1d4811a74e9d9ae7408911476810/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:04:58.978039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5442f-aaa2-4828-86e6-c61a7617c455 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8a93aae3f44d1aa9aa35ef43cec876, user_id=290e1d4811a74e9d9ae7408911476810, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:04:58.979494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5442f-aaa2-4828-86e6-c61a7617c455 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:04:58.992776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 589/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:04:58 2022] PUT /identity/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876/users/290e1d4811a74e9d9ae7408911476810/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:05:00.973666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b7b1-c532-4b95-b919-b84c282eacc3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:00.974220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b7b1-c532-4b95-b919-b84c282eacc3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:00.974220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b7b1-c532-4b95-b919-b84c282eacc3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:00.975586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 565/1154] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:00.980734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:00.981148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:00.981284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:00.998924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:01.000165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:01.044847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:01.067909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 590/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:01.092443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b7b1-c532-4b95-b919-b84c282eacc3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:01.203347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b7b1-c532-4b95-b919-b84c282eacc3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:01.237587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:01.238150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:01.238431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:01.238703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:01.249267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:05:01.254149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:05:01.255327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:05:01.256372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 566/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:05:01.261421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:01.362172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b527-edfc-4be9-a640-7a92164a0a1f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:01.395513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:01.396124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:01.396405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:01.396680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:01.397405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:01.397689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:01.399063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:01.407726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 591/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:01.413621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:01.461907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:01.511742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b8662-2962-4f48-b415-515517f87482 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:01.544716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:01.545328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:01.545607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:01.545878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] PATH_INFO: `/v3/users/290e1d4811a74e9d9ae7408911476810` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:01.547004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] RBAC: Authorizing `identity:get_user(user_id=290e1d4811a74e9d9ae7408911476810)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:01.548438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:01.550003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 567/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:05:01 2022] GET /identity/v3/users/290e1d4811a74e9d9ae7408911476810 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:01.555861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:01.598211 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:01.654013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba741f-ae76-4357-8108-981531b39cbc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:01.686481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:01.687078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:01.687385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:01.687656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:01.751781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:01.753223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:01.793336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:01.848621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 592/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:05:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:05:01.854506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:01.952285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc3e3-698e-4e73-be9f-8d48e2e76903 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:01.968602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:01.986635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f809641-c59f-4559-bab9-bef73e59393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:01.987293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f809641-c59f-4559-bab9-bef73e59393a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:01.987573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f809641-c59f-4559-bab9-bef73e59393a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:01.987845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f809641-c59f-4559-bab9-bef73e59393a None admin] PATH_INFO: `/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:01.988981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f809641-c59f-4559-bab9-bef73e59393a None admin] RBAC: Authorizing `identity:get_project(project_id=5e8a93aae3f44d1aa9aa35ef43cec876)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:01.990394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f809641-c59f-4559-bab9-bef73e59393a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:01.992072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 568/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:05:01 2022] GET /identity/v3/projects/5e8a93aae3f44d1aa9aa35ef43cec876 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:01.998118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:02.092052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb63c0-d9a6-4f22-b36e-8839b8e740ed None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:02.124549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:02.125134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:02.125412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:02.125682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:02.126445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=5e8a93aae3f44d1aa9aa35ef43cec876, user.id=290e1d4811a74e9d9ae7408911476810) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:02.126752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:02.128190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08928188-ecb1-4a9e-ba44-2df01296b4dd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:02.133670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 593/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:05:01 2022] GET /identity/v3/role_assignments?user.id=290e1d4811a74e9d9ae7408911476810&scope.project.id=5e8a93aae3f44d1aa9aa35ef43cec876&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:05:04.140102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7ad8-1ff0-4a02-af59-05813ff11f72 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:04.140630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7ad8-1ff0-4a02-af59-05813ff11f72 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:04.140630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7ad8-1ff0-4a02-af59-05813ff11f72 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:04.141965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 569/1162] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:04.147137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:04.147584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:04.147712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:04.161003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:04.167089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:04.168317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:04.233717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 594/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:04.255323 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7ad8-1ff0-4a02-af59-05813ff11f72 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:04.353112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7ad8-1ff0-4a02-af59-05813ff11f72 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:04.385285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:04.385875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:04.386151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:04.386417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:04.436958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:04.452622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:04.454048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:04.548567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 570/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:05:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:05:04.554458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:04.649673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acac41d-3fc8-4851-a652-04f93d7342b4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:04.682149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:04.682771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:04.683051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:04.683354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:04.685980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:04.690544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:04.692088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-eab4c8a0-3a90-41df-b940-3e007bed24c8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:05:04.704186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:05:04.705372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:05:04.706247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 595/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:05:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:05:04.711176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:04.791604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:04.807046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef134da-f201-46e6-b1dd-361f6bd022dc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:04.839942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7846-a449-4914-b2df-606a4717688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:04.840532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7846-a449-4914-b2df-606a4717688f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:04.841470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7846-a449-4914-b2df-606a4717688f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:04.841751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7846-a449-4914-b2df-606a4717688f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:04.842529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7846-a449-4914-b2df-606a4717688f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:04.842832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7846-a449-4914-b2df-606a4717688f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:04.844203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7846-a449-4914-b2df-606a4717688f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:04.851014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 571/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 05:05:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:06.848580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a95f9-0e6c-4ed1-a779-7fc541b1708a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:06.849110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a95f9-0e6c-4ed1-a779-7fc541b1708a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:06.849110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a95f9-0e6c-4ed1-a779-7fc541b1708a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:06.850474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 596/1167] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:06.855741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfbdf5-8d92-4c56-8f5b-a47f2d7c85fc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:06.856115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfbdf5-8d92-4c56-8f5b-a47f2d7c85fc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:06.856289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfbdf5-8d92-4c56-8f5b-a47f2d7c85fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:06.874003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cbbfbdf5-8d92-4c56-8f5b-a47f2d7c85fc None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:06.875218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cbbfbdf5-8d92-4c56-8f5b-a47f2d7c85fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:06.939099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 572/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:06.962782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a95f9-0e6c-4ed1-a779-7fc541b1708a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:07.059798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a95f9-0e6c-4ed1-a779-7fc541b1708a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:07.092690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6bf75-2534-4142-b443-a146d0b3469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:07.093286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6bf75-2534-4142-b443-a146d0b3469d None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:07.093561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6bf75-2534-4142-b443-a146d0b3469d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:07.093829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6bf75-2534-4142-b443-a146d0b3469d None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:07.094525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6bf75-2534-4142-b443-a146d0b3469d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:07.095905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6bf75-2534-4142-b443-a146d0b3469d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:07.111884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 597/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Fri Aug 5 05:05:06 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:05:09.137074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1922d-39be-4aae-b192-f3332ccd7a0a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:09.137606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1922d-39be-4aae-b192-f3332ccd7a0a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:09.137716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1922d-39be-4aae-b192-f3332ccd7a0a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:09.138986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 573/1170] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:09.144099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:09.144487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:09.144645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:09.162168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:09.163404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:09.215238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:09.232799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 598/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:09.256626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1922d-39be-4aae-b192-f3332ccd7a0a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:09.337049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:09.360289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1922d-39be-4aae-b192-f3332ccd7a0a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:09.394614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184999a8-39b1-407f-bcea-ea86a16fbb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:09.395191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184999a8-39b1-407f-bcea-ea86a16fbb96 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:09.395474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184999a8-39b1-407f-bcea-ea86a16fbb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:09.395745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184999a8-39b1-407f-bcea-ea86a16fbb96 None admin] PATH_INFO: `/v3/domains/7a49cd4164534a40a7eaf2523613e540` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:09.406694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184999a8-39b1-407f-bcea-ea86a16fbb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7a49cd4164534a40a7eaf2523613e540)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:09.408145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184999a8-39b1-407f-bcea-ea86a16fbb96 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:09.409711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 574/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Aug 5 05:05:09 2022] GET /identity/v3/domains/7a49cd4164534a40a7eaf2523613e540 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:09.415539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:09.510117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274775-b327-403e-a16d-0bd3bd0145e4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:09.542722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4e14-f8c0-48ff-95af-07c64d5d57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:09.543347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4e14-f8c0-48ff-95af-07c64d5d57ec None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:09.543624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4e14-f8c0-48ff-95af-07c64d5d57ec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:09.544438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4e14-f8c0-48ff-95af-07c64d5d57ec None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:09.545111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4e14-f8c0-48ff-95af-07c64d5d57ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:09.546552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4e14-f8c0-48ff-95af-07c64d5d57ec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:09.571511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 599/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:05:09 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:05:11.576939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a571c5-bc08-4eee-853e-e7c431194d45 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:11.577457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a571c5-bc08-4eee-853e-e7c431194d45 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:11.577457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a571c5-bc08-4eee-853e-e7c431194d45 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:11.578691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 575/1174] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:11.583778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:11.584175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:11.584336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:11.602571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:11.603782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:11.632609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:11.669746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 600/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:11.694152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a571c5-bc08-4eee-853e-e7c431194d45 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:11.792639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a571c5-bc08-4eee-853e-e7c431194d45 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:11.824727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f2691-8e10-46a9-a1ff-cf795d18e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:11.825905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f2691-8e10-46a9-a1ff-cf795d18e544 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:11.826179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f2691-8e10-46a9-a1ff-cf795d18e544 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:11.826446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f2691-8e10-46a9-a1ff-cf795d18e544 None admin] PATH_INFO: `/v3/domains/7a49cd4164534a40a7eaf2523613e540` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:11.827647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f2691-8e10-46a9-a1ff-cf795d18e544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7a49cd4164534a40a7eaf2523613e540)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:11.829003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f2691-8e10-46a9-a1ff-cf795d18e544 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:11.830544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 576/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Aug 5 05:05:11 2022] GET /identity/v3/domains/7a49cd4164534a40a7eaf2523613e540 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:11.836123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:11.931720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef11351-eaf1-4f94-95d6-9d429d40cd87 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:11.964489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d409ae-ce6b-4dc7-8d22-524593a2f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:11.965087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d409ae-ce6b-4dc7-8d22-524593a2f7cb None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:11.965367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d409ae-ce6b-4dc7-8d22-524593a2f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:11.966174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d409ae-ce6b-4dc7-8d22-524593a2f7cb None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:11.966847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d409ae-ce6b-4dc7-8d22-524593a2f7cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:11.968324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d409ae-ce6b-4dc7-8d22-524593a2f7cb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:11.989394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 601/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:05:11 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:05:14.010705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5115da-8188-44e5-ab4b-9da6576922e6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:14.011285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5115da-8188-44e5-ab4b-9da6576922e6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:14.011285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5115da-8188-44e5-ab4b-9da6576922e6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:14.012802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 577/1178] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:14.017784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:14.018174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:14.018325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:14.037349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:14.038523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:14.056238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:14.105471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 602/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:14.129621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5115da-8188-44e5-ab4b-9da6576922e6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:14.138772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:14.230049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5115da-8188-44e5-ab4b-9da6576922e6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:14.262953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:14.263671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:14.263954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:14.264225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:14.274283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:05:14.279799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:05:14.280914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:05:14.281957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 578/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:05:14.286992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:14.381041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96972a-0520-46d5-8080-88a41398bad6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:14.414215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:14.414815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:14.415096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:14.415391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:14.416087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:14.416385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:14.417739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:14.425598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 603/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:14.431367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:14.495542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:14.529950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0d89-12b5-4ae2-979f-25c305ebd20d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:14.563012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:14.563728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:14.564011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:14.564286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] PATH_INFO: `/v3/users/5cbcf80401c74f159180eb3c1f4acbc9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:14.577401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] RBAC: Authorizing `identity:get_user(user_id=5cbcf80401c74f159180eb3c1f4acbc9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:14.578817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:14.580444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 579/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:05:14 2022] GET /identity/v3/users/5cbcf80401c74f159180eb3c1f4acbc9 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:14.586153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:14.603955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:14.689703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f68e9-cf0c-436c-838e-177f65951f7b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:14.722823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:14.723458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:14.723738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:14.724006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:14.790186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:14.791601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:14.808570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:14.889034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 604/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:05:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:05:14.894990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:14.994099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745d7e-9029-4a4d-ae94-ccc8db37187d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:15.027362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:15.039234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840351c-1da8-4b85-b5b4-b9348e648bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:15.040583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840351c-1da8-4b85-b5b4-b9348e648bae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:15.040583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840351c-1da8-4b85-b5b4-b9348e648bae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:15.040583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840351c-1da8-4b85-b5b4-b9348e648bae None admin] PATH_INFO: `/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:15.041642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840351c-1da8-4b85-b5b4-b9348e648bae None admin] RBAC: Authorizing `identity:get_project(project_id=bb5d36c9b1bb49eba6920df41f2e74f9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:15.043211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840351c-1da8-4b85-b5b4-b9348e648bae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:15.045101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 580/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:05:14 2022] GET /identity/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:15.051478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:15.146721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5181b-ad51-4441-ac43-2b7e3db1a743 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:15.163018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:15.181166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:15.181771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:15.182046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:15.182314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:15.183082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=bb5d36c9b1bb49eba6920df41f2e74f9, user.id=5cbcf80401c74f159180eb3c1f4acbc9) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:15.183411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:15.185012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148f687-07c9-4fe4-b035-bd99770b068d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:15.190246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 605/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:05:15 2022] GET /identity/v3/role_assignments?user.id=5cbcf80401c74f159180eb3c1f4acbc9&scope.project.id=bb5d36c9b1bb49eba6920df41f2e74f9&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:17.147608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d921f7-1c9f-4cf8-9d06-275982fc22d4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.148264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d921f7-1c9f-4cf8-9d06-275982fc22d4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.148264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d921f7-1c9f-4cf8-9d06-275982fc22d4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.149469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 581/1186] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:17.155023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.155460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.155588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.173868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:17.175022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:17.238827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 606/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:05:17.260052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d921f7-1c9f-4cf8-9d06-275982fc22d4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:17.359813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d921f7-1c9f-4cf8-9d06-275982fc22d4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:17.399123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:17.399700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.399975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.400240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.409931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:05:17.414671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:05:17.415882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:05:17.417213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 582/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:05:17.422315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:17.517002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74485000-1180-4c56-a124-a340953d6fe3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:17.527098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:17.551713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:17.552317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.552595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.552867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.553567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:17.553867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:17.555262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:17.563536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 607/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:17.569371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:17.620935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:17.667452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8186-58b9-4915-b069-e8ea599ed6b2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:17.700342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:17.700953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.701232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.701505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] PATH_INFO: `/v3/users/5cbcf80401c74f159180eb3c1f4acbc9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.702640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] RBAC: Authorizing `identity:get_user(user_id=5cbcf80401c74f159180eb3c1f4acbc9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:17.704093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:17.705653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 583/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:05:17 2022] GET /identity/v3/users/5cbcf80401c74f159180eb3c1f4acbc9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:17.711434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:17.810760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c87c1d-24a4-4f0a-9852-a0fd3eadf378 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:17.843297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32842e-07ef-42c9-8d04-d507e5535e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:17.843922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32842e-07ef-42c9-8d04-d507e5535e4d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.844203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32842e-07ef-42c9-8d04-d507e5535e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.844472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32842e-07ef-42c9-8d04-d507e5535e4d None admin] PATH_INFO: `/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.845608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32842e-07ef-42c9-8d04-d507e5535e4d None admin] RBAC: Authorizing `identity:get_project(project_id=bb5d36c9b1bb49eba6920df41f2e74f9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:17.847036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32842e-07ef-42c9-8d04-d507e5535e4d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:17.848713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 608/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:05:17 2022] GET /identity/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:17.854686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:17.952543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c434b6-7641-4ff5-b383-403fd7ae86ba None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:17.971690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:17.986104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efca11-13db-4cea-a5d1-93b6002650c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:17.986746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efca11-13db-4cea-a5d1-93b6002650c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:17.987043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efca11-13db-4cea-a5d1-93b6002650c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:17.987346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efca11-13db-4cea-a5d1-93b6002650c0 None admin] PATH_INFO: `/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9/users/5cbcf80401c74f159180eb3c1f4acbc9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:17.989221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efca11-13db-4cea-a5d1-93b6002650c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d36c9b1bb49eba6920df41f2e74f9, user_id=5cbcf80401c74f159180eb3c1f4acbc9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:17.990620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efca11-13db-4cea-a5d1-93b6002650c0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:18.002752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 584/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:05:17 2022] PUT /identity/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9/users/5cbcf80401c74f159180eb3c1f4acbc9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:05:19.975410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd0a9-5d90-4fb6-bdc6-2b944c3faee8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:19.975962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd0a9-5d90-4fb6-bdc6-2b944c3faee8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:19.975962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd0a9-5d90-4fb6-bdc6-2b944c3faee8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:19.977282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 609/1193] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:05:19.982365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:19.982787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:19.982888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:20.001088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:05:20.002249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:05:20.071327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 585/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:05:20.096542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd0a9-5d90-4fb6-bdc6-2b944c3faee8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:20.140493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:20.199208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd0a9-5d90-4fb6-bdc6-2b944c3faee8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:20.232718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:20.233276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:20.233557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:20.233824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:20.243406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:05:20.249049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:05:20.250135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:05:20.251011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 610/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:05:20.256203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:20.350230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8ebaf-1ad9-467a-929e-de7d32086022 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:20.361172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:20.385622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:20.386219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:20.386496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:20.386765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:20.387527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:20.387830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:20.389178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:20.396913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 586/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:05:20.402722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:20.495793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:20.499450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643e485-7b4d-4023-878c-934c4733d845 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:20.531965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:20.532584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:20.532867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:20.533140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] PATH_INFO: `/v3/users/5cbcf80401c74f159180eb3c1f4acbc9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:20.534299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] RBAC: Authorizing `identity:get_user(user_id=5cbcf80401c74f159180eb3c1f4acbc9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:20.535758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:20.537325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 611/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 05:05:20 2022] GET /identity/v3/users/5cbcf80401c74f159180eb3c1f4acbc9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:20.543068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:20.639981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119fc2-a31f-4186-889a-f59cf92d88cb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:20.672013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:20.672602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:20.672877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:20.673143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:20.712140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:20.738522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:20.739965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:20.837907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 587/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:05:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:05:20.844236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:20.942968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc6702-09c1-4299-ab6e-b13f2a2b4756 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:20.976767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf90c-0cbe-4ee9-9609-d3535b0b6d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:20.977437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf90c-0cbe-4ee9-9609-d3535b0b6d5f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:20.977661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf90c-0cbe-4ee9-9609-d3535b0b6d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:20.977928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf90c-0cbe-4ee9-9609-d3535b0b6d5f None admin] PATH_INFO: `/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:20.979051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbf90c-0cbe-4ee9-9609-d3535b0b6d5f None admin] RBAC: Authorizing `identity:get_project(project_id=bb5d36c9b1bb49eba6920df41f2e74f9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:20.980505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbf90c-0cbe-4ee9-9609-d3535b0b6d5f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:20.982896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 612/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 05:05:20 2022] GET /identity/v3/projects/bb5d36c9b1bb49eba6920df41f2e74f9 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:20.989167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:05:21.061439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:21.097791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d29f-3c17-477e-b40a-7347f26a93d9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:05:21.134927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:05:21.135572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:05:21.135855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:05:21.136140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:05:21.138044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=bb5d36c9b1bb49eba6920df41f2e74f9, user.id=5cbcf80401c74f159180eb3c1f4acbc9) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:05:21.138354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:05:21.139818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65392c63-5926-4c68-b4f5-2561f0b8b926 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:05:21.146912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 588/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:05:20 2022] GET /identity/v3/role_assignments?user.id=5cbcf80401c74f159180eb3c1f4acbc9&scope.project.id=bb5d36c9b1bb49eba6920df41f2e74f9&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:05:30.972608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=82 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:31.143607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=32 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:16.119264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13062f1-dabf-48e7-b5a7-ed0730ff6e46 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:16.120470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13062f1-dabf-48e7-b5a7-ed0730ff6e46 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:16.120470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13062f1-dabf-48e7-b5a7-ed0730ff6e46 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:16.122204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 613/1201] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:16.128220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:16.128734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:16.128831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:16.147355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:16.148554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:16.237929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 589/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:16.267079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13062f1-dabf-48e7-b5a7-ed0730ff6e46 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:16.396532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13062f1-dabf-48e7-b5a7-ed0730ff6e46 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:16.443718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:16.444347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:16.444647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:16.444886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:16.459459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:16.460935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:16.477794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:16.479777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:16.481080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:16.481080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:16.481080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:16.481080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:16.482840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 614/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:16.489691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:16.629628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa0c7-36a1-491f-a9c9-49c4e68e9683 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:16.671035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:16.679627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:16.680794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:16.681237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:16.683617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:16.684365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:16.684672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:16.686038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c37f-f131-4e7a-ab33-9d229dfb3fa1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:16.703402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 590/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:16.709623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:16.776729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:16.834191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612a40b-5d5d-4bae-b8c4-9f290a09d43c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:16.877166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac4be5-359a-440f-b5f7-f91793a9d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:16.877947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4be5-359a-440f-b5f7-f91793a9d0be None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:16.878220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4be5-359a-440f-b5f7-f91793a9d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:16.878583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4be5-359a-440f-b5f7-f91793a9d0be None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:16.879479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac4be5-359a-440f-b5f7-f91793a9d0be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:16.881781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac4be5-359a-440f-b5f7-f91793a9d0be None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:16.907885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 615/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 05:06:16 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:06:19.262610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323cca1-c74b-4ed4-a429-37429586fa19 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:19.262610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323cca1-c74b-4ed4-a429-37429586fa19 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:19.262610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323cca1-c74b-4ed4-a429-37429586fa19 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:19.262610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 591/1206] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:19.269017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:19.269498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:19.269626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:19.289878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:19.291133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:19.374500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 616/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:19.398044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323cca1-c74b-4ed4-a429-37429586fa19 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:19.530466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323cca1-c74b-4ed4-a429-37429586fa19 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:19.577993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:19.578692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:19.578958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:19.579256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:19.590955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:06:19.595847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:19.599314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:19.600221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 592/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:06:19.605631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:19.650708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:19.723839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480871c-114b-4dcf-b7a1-a92d6f473a8a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:19.768547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:19.769629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:19.770193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:19.770671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:19.771897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:19.772213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:19.773606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:19.782436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 617/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:06:19.788534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:19.848239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:19.914153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e924f7-e77e-4395-a56d-f97043b5a77d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:19.960860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:19.961500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:19.961790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:19.962047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:19.974907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:19.976381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:19.990910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:19.992051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:19.993235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:19.993235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:19.993235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:19.993235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:19.993235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 593/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:19.998800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:20.114480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:20.117635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02534f5-73f0-451f-bc14-639c28be548b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:20.153254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:20.153924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:20.154230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:20.154505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:20.155213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:20.155513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:20.156874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:20.170072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 618/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:06:20.176410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:20.310568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6007b-2aca-4406-9cef-e7b5c85403da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:20.312362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:20.355882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:20.356560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:20.356816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:20.357076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:20.365479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:20.366988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:06:20.381319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:20.382447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:20.383472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 594/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:06:20.389018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:20.496045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7f141-1732-44e0-bed2-dd8ed9b002da None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:20.534876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:20.535550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:20.535824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:20.536146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:20.536884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:20.537287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:20.538622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:20.556535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 619/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 05:06:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:06:20.562529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:20.681142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ea83-e478-4eb1-adca-a12ee6683e27 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:20.721254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:20.721899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:20.722208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:20.722538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:20.758399 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:20.800729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:20.802212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:20.922511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 595/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:06:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:20.924163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:20.945716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:21.038213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2495dd-4bcd-4147-abd7-3473d284b472 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:21.077085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:21.078010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:21.078446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:21.078871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:21.090324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:21.091824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:21.107005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:21.108146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:21.109264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:21.109264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:21.109264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:21.109264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:21.109264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 620/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:21.113944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:21.187651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:21.236718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2c45-524b-46e8-a476-1a2bdf6aa6a0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:21.275141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:21.275786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:21.276086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:21.276446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:21.277122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:21.277416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:21.278792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:21.291196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 596/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:21.298619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:21.378535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:21.411993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964368-2586-4c39-b250-11fcf7a496dc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:21.452590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:21.453356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:21.453642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:21.453917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:21.461790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:21.463904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:06:21.477033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:21.478105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:21.479706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 621/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:06:21.485588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:21.610625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad375-226a-459c-95ec-39c0aa74005d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:21.641598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:21.656651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:21.657412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:21.657787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:21.658153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:21.658992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:21.659423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:21.661026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e3d9-a68f-4626-b49f-43bba885910b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:21.679505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 597/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:21.680920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:21.809362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca356ac4-c865-4ee5-8c72-608f0bcc2a20 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:21.844441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:21.850633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:21.851290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:21.851569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:21.851838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:21.852616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=5402629299ee411d988f130f03dbcfba) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:21.852926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:21.854555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee900803-0237-4b24-876c-8dd9c664e328 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:21.860424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 622/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:06:21 2022] GET /identity/v3/role_assignments?user.id=5402629299ee411d988f130f03dbcfba&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:23.939062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec869-150a-4b66-bb16-b944b2ed11a4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:23.939631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec869-150a-4b66-bb16-b944b2ed11a4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:23.939631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec869-150a-4b66-bb16-b944b2ed11a4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:23.941130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 598/1220] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:23.946875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:23.947328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:23.947460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:23.967570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:23.968973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:24.042930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 623/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:24.066990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ec869-150a-4b66-bb16-b944b2ed11a4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:24.178342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ec869-150a-4b66-bb16-b944b2ed11a4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:24.219430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:24.219944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:24.220240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:24.220484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:24.231248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:06:24.236064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:24.237499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:24.238553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 599/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:24.247014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:24.359012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dff050-0339-42a5-820f-e48d69207bb8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:24.383171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:24.395468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:24.396204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:24.396494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:24.396769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:24.397486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:24.397792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:24.399190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:24.411181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 624/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:24.417626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:24.466874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:24.534156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889f21-ce80-456d-99ee-c9e1b8f5bc71 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:24.572194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:24.572922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:24.573215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:24.573600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:24.584546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:24.585974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:24.603083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:24.604826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:24.605896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:24.605896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:24.605896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:24.605896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:24.605896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 600/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:24.610475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:24.717974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c6e2-07a3-4af8-ad93-116a20609235 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:24.759636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:24.760717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:24.761002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:24.761276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:24.761963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:24.762264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:24.763663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:24.775396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 625/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:24.780964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:24.884400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:24.893001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702c3ca-81fa-417f-a666-ee4e5a1189b9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:24.928850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:24.929474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:24.929749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:24.930022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:24.937826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:24.939519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:06:24.952423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:24.958738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:24.960105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 601/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:24.960830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:25.006214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:25.062347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54ed3f-d7ba-4ddb-ade4-3197c107ba7f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:25.098025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:25.098742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:25.098947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:25.099238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:25.100014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:25.100310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:25.101731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:25.124694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 626/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 05:06:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:25.126492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:25.243481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1853-5888-47f1-96d6-e629d0180738 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:25.278880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:25.279609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:25.279896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:25.280170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:25.290609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:25.292751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:25.309107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:25.310266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:25.311602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:25.311602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:25.311602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:25.311602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:25.311602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 602/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:25.316510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:25.441579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44138f64-af6d-40ca-8892-6bd48fe6389e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:25.443844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:25.478691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:25.479373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:25.479653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:25.479920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:25.480802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:25.481310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:25.482713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:25.500242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 627/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:25.501482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:25.511348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:25.620137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f70154-0eb7-4105-8c10-72e2857878b7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:25.658869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:25.659726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:25.660112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:25.660370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:25.668539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:25.670221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:06:25.683266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:25.684359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:25.685422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 603/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:25.691689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:25.804882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af901b-b185-49c0-ad13-fc2e32dc4cce None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:25.843435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:25.844113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:25.844453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:25.844753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:25.845553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:25.845853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:25.847455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5caa-7b72-44ee-9ca7-2a0f2621ddae None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:25.861697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 628/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:06:25.867897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:25.940193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:25.978670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f352e3d-8d40-4b0a-932c-1f9682fb28be None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:26.016042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aefc6f-f01f-4b49-ab80-2692117f91a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:26.016761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aefc6f-f01f-4b49-ab80-2692117f91a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:26.017091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aefc6f-f01f-4b49-ab80-2692117f91a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:26.017425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aefc6f-f01f-4b49-ab80-2692117f91a6 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/5402629299ee411d988f130f03dbcfba/roles/ccc5529648ee470dbe16633db9faa17e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:26.034255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aefc6f-f01f-4b49-ab80-2692117f91a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=5402629299ee411d988f130f03dbcfba, role_id=ccc5529648ee470dbe16633db9faa17e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:26.035725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aefc6f-f01f-4b49-ab80-2692117f91a6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:26.049036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 604/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:06:25 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/5402629299ee411d988f130f03dbcfba/roles/ccc5529648ee470dbe16633db9faa17e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:06:28.217832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1cf9-8fea-4d12-b6cc-4e9d1c62d151 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:28.218402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1cf9-8fea-4d12-b6cc-4e9d1c62d151 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:28.218402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1cf9-8fea-4d12-b6cc-4e9d1c62d151 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:28.219936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 629/1233] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:28.225568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:28.226152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:28.226152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:28.243898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:28.245633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:28.318110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 605/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:28.344861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1cf9-8fea-4d12-b6cc-4e9d1c62d151 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:28.376065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:28.464206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1cf9-8fea-4d12-b6cc-4e9d1c62d151 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:28.502160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:28.502896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:28.503301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:28.503644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:28.515510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:06:28.520453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:28.521574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 05:06:28.522437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:28.526987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 630/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 05:06:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:28.528082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:28.577676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:28.638989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddbe94-42bb-4941-a632-b3909b317972 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:28.675711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:28.676336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:28.676615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:28.676885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:28.677593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:28.677891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:28.679290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:28.688121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 606/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 05:06:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:28.694597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:28.785427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:28.802796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc2f4-692a-4bf6-8b55-6bd516d14ffc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:28.840062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:28.840707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:28.840980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:28.841247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:28.851912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:28.853396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:28.867233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:28.868348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:28.875124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:28.875124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:28.875124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:28.875124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:28.875124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 631/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:28.875477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:28.974395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b341a4a-0a8b-49d7-9141-d843867135c2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:28.983662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:29.009034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:29.009649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:29.010495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:29.011008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:29.011424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:29.011874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:29.013429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:29.028647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 607/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:29.035614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:29.146705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953a86-918d-4a5e-9065-9ec5ec6422da None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:29.190603 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:29.191286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:29.191573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:29.191848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:29.194536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:29.202580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:29.204104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:06:29.218507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:29.220118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:29.221091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 632/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:29.225590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:29.332351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d93f9-a73d-4720-aa4c-fce66dc50d27 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:29.371948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:29.372757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:29.373179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:29.373455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:29.374570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:29.375049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:29.376869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:29.397864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 608/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 05:06:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:29.404183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:29.511840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02eb03-d488-4f14-af82-1fe0e346ba44 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:29.546366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:29.547070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:29.547446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:29.547786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:29.610225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:29.617171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:29.618624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:29.722924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 633/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:06:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:29.729609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:29.763016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:29.848743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f559cc-3798-47dd-870e-b66a9d554436 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:29.885692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:29.886378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:29.886660 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:29.886931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:29.897463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:29.898988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:29.917510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:29.918611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:29.919966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:29.919966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:29.919966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:29.919966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:29.919966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 609/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:29.925020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:30.024242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:30.030958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac5c2c-ee52-4d9f-8e9f-110ce0fd5fcd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:30.078839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:30.079486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:30.079765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:30.080036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:30.080715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:30.081013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:30.082427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:30.096958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 634/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:30.103566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:30.199296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:30.226218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11485a97-b2e1-404e-8bbd-581106d8a555 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:30.267775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:30.268617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:30.269039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:30.269323 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:30.279094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:30.280893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:06:30.295296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:30.296640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:30.297677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 610/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:30.303905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:30.417719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edaaa0-2351-4c54-87da-0cf9c43456a2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:30.461522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:30.462073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:30.462281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:30.462544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:30.463847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:30.464292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:30.465566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188a740-20c0-45e6-95a8-b49c40fd592e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:30.477459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 635/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:30.484344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:30.596358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68b35-d406-4849-90ba-f57d627a2212 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:30.636509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:30.637210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:30.637485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:30.637752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:30.638524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] RBAC: Adding query filter params (role.id=ccc5529648ee470dbe16633db9faa17e, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=5402629299ee411d988f130f03dbcfba) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:30.638823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:30.640283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff0ff9-d46e-4b47-826d-2cd136e008c7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:30.649260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 611/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:06:30 2022] GET /identity/v3/role_assignments?user.id=5402629299ee411d988f130f03dbcfba&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=ccc5529648ee470dbe16633db9faa17e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:32.818611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adced3-7797-48d2-8e22-eb11fe6e6b9c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:32.819253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adced3-7797-48d2-8e22-eb11fe6e6b9c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:32.819253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adced3-7797-48d2-8e22-eb11fe6e6b9c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:32.820569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 636/1247] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:06:32.831232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:32.831232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:32.831232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:32.835658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:32.852226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:32.853533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:32.925182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 612/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:32.948997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adced3-7797-48d2-8e22-eb11fe6e6b9c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:32.969387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:33.063103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adced3-7797-48d2-8e22-eb11fe6e6b9c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:33.100808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:33.101345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:33.101657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:33.101962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:33.113224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:06:33.119609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:33.120843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:33.122127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 637/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:33.126797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:33.240637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a7a6-1dda-434f-bd03-d706f17247be None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:33.271391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:33.276973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:33.277705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:33.278048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:33.278379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:33.279361 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:33.279790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:33.281433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:33.290597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 613/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:33.297055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:33.377989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:33.406509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e6b53-d213-4f7b-af1d-578c44587f5d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:33.443801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:33.444453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:33.444709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:33.444977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:33.456738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:33.458198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:33.473345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:33.474688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:33.475827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:33.475827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:33.475827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:33.475827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:33.475827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 638/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:33.483027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:33.605527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62fbbb-e977-48f4-a681-2ced1875418c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:33.645070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:33.645610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:33.645899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:33.646174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:33.646858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:33.647180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:33.648623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:33.662269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 614/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:06:33.668647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:33.789449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde73ee-e1ab-4d91-a9f0-729b7e24bc92 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:33.820007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:33.829340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:33.830004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:33.830278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:33.830554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:33.840216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:33.841726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:06:33.855029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:33.856274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:33.857605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:33.860993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 639/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:33.862209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:33.925212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:33.977423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee9e42-160d-428c-9426-6addb8954fcb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:34.015612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:34.016221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:34.016500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:34.016771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:34.017552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:34.017855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:34.019298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:34.038692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 615/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 05:06:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:34.045064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:34.156352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5a4e-ef8c-49b0-bc2c-8551b5a1d50a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:34.202380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:34.203400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:34.203875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:34.204317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:34.271134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:34.285917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:34.287556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:34.401244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 640/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:06:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:34.407144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:34.524001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455c0d-f080-4737-af6b-d84409cd0857 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:34.539556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:34.564228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:34.564926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:34.565303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:34.565521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:34.577200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:34.578734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:34.595606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:34.596777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:34.598064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:34.598064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:34.598064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:34.598064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:34.598064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 616/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:34.602622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:34.694601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:34.709672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1254f-1c9a-4ba2-a8bc-f2465298c3c6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:34.745461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:34.746076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:34.746355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:34.746607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:34.747329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:34.747633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:34.749097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:34.764820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 641/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:34.771916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:34.886294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c878a88-43ec-449f-b2c1-621e3dfbb928 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:34.929367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:34.930389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:34.930918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:34.931901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:34.942722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:34.945139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:06:34.959805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:34.961103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:34.962217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 617/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:06:34.967279 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:35.087248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e92d-37b8-46d5-8519-07fd93b6ba41 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:35.124046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:35.124781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:35.125094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:35.125399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:35.126231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:35.126633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:35.128095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d186cd-b978-41ea-bf66-95ce32192b7d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:35.146327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 642/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:35.147731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:35.178171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:35.262845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dffada-499a-470b-80bd-99325d75db39 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:35.297576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:35.298204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:35.298492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:35.298771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:35.299669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=5402629299ee411d988f130f03dbcfba) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:35.299999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:35.301654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5269176-340d-42cd-a4f8-32287a42c2c3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:35.308065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 618/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:06:35 2022] GET /identity/v3/role_assignments?user.id=5402629299ee411d988f130f03dbcfba&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:37.394871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dbb78-73ec-4ff4-8c22-9dddaf7e3906 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:37.395479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dbb78-73ec-4ff4-8c22-9dddaf7e3906 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:37.395479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dbb78-73ec-4ff4-8c22-9dddaf7e3906 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:37.396777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 643/1261] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:37.402393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:37.402815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:37.402936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:37.421178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:37.422273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:37.487568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 619/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:37.512525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dbb78-73ec-4ff4-8c22-9dddaf7e3906 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:37.523071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:37.610825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dbb78-73ec-4ff4-8c22-9dddaf7e3906 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:37.643746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:37.644369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:37.644647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:37.644917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:37.655243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:06:37.660025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:37.661084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:37.662114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 644/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:37.669151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:37.686970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:37.772267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa24dc-75a7-4346-93c1-a9a33953a3dc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:37.808449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:37.809107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:37.809397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:37.809699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:37.810505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:37.810791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:37.812295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:37.821466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 620/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:37.829043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:37.893908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:37.925732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b03cc4-8d31-4ef6-9341-0617b3511aeb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:37.958166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:37.958722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:37.958999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:37.959294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:37.969893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:37.971365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:37.985585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:37.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:37.987759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:37.987759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:37.987759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:37.987759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:37.987759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 645/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:37.992389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:38.070421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:38.090161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f707123-a4e6-41aa-b9a1-5728253d6834 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:38.123291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:38.123886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:38.124164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:38.124434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:38.125108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:38.125409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:38.126753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:38.138435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 621/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:38.144179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:38.243459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265fbc-e108-4957-83ad-d53d1b55dde4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:38.262374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:38.276702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:38.277320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:38.277594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:38.277860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:38.284954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:38.286380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:06:38.297307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:38.298380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:38.299407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 646/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:38.304355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:38.399867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad57a27-653c-4860-a241-1cda0b918230 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:38.432350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:38.432925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:38.433205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:38.433473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:38.434236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:38.434536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:38.436027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:38.444320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:38.453660 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 622/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 05:06:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:38.459238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:38.556850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57745-556e-4197-83d6-1f1db9a0b582 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:38.589846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:38.590468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:38.590748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:38.591017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:38.601077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:38.602514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:38.616154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:38.617189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:38.618125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:38.618125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:38.618125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:38.618125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:38.618125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 647/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:38.623502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:38.721845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef253d-2aa9-44c0-8271-5da5ab1e024b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:38.755231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:38.755831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:38.756111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:38.756384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:38.757054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:38.757353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:38.758700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:38.770619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 623/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:38.776577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:38.817146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:38.885722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9794739-387a-414d-ae73-fc32f0cd0506 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:38.917038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:38.917658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:38.917939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:38.918208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:38.924654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:38.926100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:06:38.938053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:38.939075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:38.940370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 648/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:38.945032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:39.003288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:39.044341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e610-0134-42c4-b68b-c7a55e648c6b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:39.077053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:39.077599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:39.077882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:39.078157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:39.078891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:39.079221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:39.080643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6d29c-da49-420a-b462-284db0d3c637 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:39.092246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 624/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:39.098081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:39.187057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:39.195759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7bf34-f6e8-4fd2-a669-951b5ed4b978 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:39.227620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eebbe-4bda-4f2d-9726-f278270755f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:39.228997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eebbe-4bda-4f2d-9726-f278270755f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:39.229116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eebbe-4bda-4f2d-9726-f278270755f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:39.229318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eebbe-4bda-4f2d-9726-f278270755f7 None admin] PATH_INFO: `/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/5402629299ee411d988f130f03dbcfba/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:39.231222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eebbe-4bda-4f2d-9726-f278270755f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=35a66bcc751f400ca1a0f307f6bef50e, user_id=5402629299ee411d988f130f03dbcfba, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:39.232648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eebbe-4bda-4f2d-9726-f278270755f7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:39.245092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 649/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 05:06:39 2022] PUT /identity/v3/projects/35a66bcc751f400ca1a0f307f6bef50e/users/5402629299ee411d988f130f03dbcfba/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:06:41.229915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100895df-ec89-40d7-87c4-e5a7ad431911 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:41.230466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100895df-ec89-40d7-87c4-e5a7ad431911 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:41.230466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100895df-ec89-40d7-87c4-e5a7ad431911 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:41.231812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 625/1274] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:41.236979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:41.237403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:41.237537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:41.255785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:41.256965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:41.321392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 650/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:41.347122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100895df-ec89-40d7-87c4-e5a7ad431911 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:41.447343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100895df-ec89-40d7-87c4-e5a7ad431911 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:41.463730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:41.481166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:41.481788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:41.482068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:41.482340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:41.492159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 05:06:41.497112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:41.498206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:41.499451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 626/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 05:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:41.504201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:41.582194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:41.601560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fa662-6bc1-4e0b-b2c2-403767328a3f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:41.635023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:41.635659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:41.635941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:41.636213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:41.636917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:41.637219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:41.638579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:41.646330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 651/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 05:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:41.652258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:41.748706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd038e6-82ec-430b-b809-39e84467a442 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:41.786006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:41.786733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:41.786920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:41.787366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:41.798033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:41.799495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:41.816769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:41.817863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:41.818966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:41.818966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:41.818966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:41.818966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:41.818966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 627/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:41.825072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:41.922167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28df4e-5d0c-4db4-8c15-a8aff479f641 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:41.955010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:41.955636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:41.955913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:41.956181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:41.956851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:41.957149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:41.958492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:41.969511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 652/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:41.975057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:42.005998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:42.073389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fcb4-a4c6-4240-9bc0-fcf421c47c17 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:42.105658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:42.106270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:42.106549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:42.106819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:42.113967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:42.115405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 05:06:42.126882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:42.128063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:42.129035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 628/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 05:06:42.133703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:42.137538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:42.230535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65072d-62a5-4830-a638-94427893df36 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:42.263264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:42.263810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:42.264088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:42.264357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:42.265132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:42.265434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:42.266861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:42.283776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 653/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 05:06:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:42.289504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:42.377962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:42.387550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4e45-0471-420c-92fb-76f248ae4269 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:42.420964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:42.421552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:42.421827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:42.422093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:42.487762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:42.489172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:42.579146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:42.589801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 629/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 05:06:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 05:06:42.595629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:42.655263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:42.694095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74caec6-ade1-4a0d-b5a1-14d2952f6f10 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:42.727572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:42.728265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:42.728545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:42.728825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:42.738376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:42.739855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 05:06:42.753899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:42.755011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:42.756005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 05:06:42.756005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 05:06:42.756005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 05:06:42.756005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:42.756005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 654/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:42.761346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:42.863519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990265b-a85d-4d0f-a9b9-da92f8632e27 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:42.896240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:42.896838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:42.897117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:42.897391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:42.898063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:42.898367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:42.900365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:42.911461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 630/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 05:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:42.917294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:43.014800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2008c-3e3c-49a1-84b7-efb65c9fe3dc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:43.028451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:43.048105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:43.048756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:43.049033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:43.049301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:43.055611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:43.057043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 05:06:43.067815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:43.068843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 05 05:06:43.069774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 655/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 05:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:43.076002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:43.125008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:43.173671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e508a-6c68-4a43-8df8-3bf358d87951 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:43.206896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:43.207520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:43.207797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:43.208067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:43.208789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:43.209086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:43.210487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895321b-5211-4552-805c-c2e222b0415b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:43.221923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 631/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 05:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:43.227973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:43.324365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22814d3-5541-4330-b366-307e81e93f35 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:43.355742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:43.356337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:43.356612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:43.356880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:43.357644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] RBAC: Adding query filter params (role.id=3508b429d46f4c67aa9e3cbb594e35e4, scope.project.id=35a66bcc751f400ca1a0f307f6bef50e, user.id=5402629299ee411d988f130f03dbcfba) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:43.357945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:43.359377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfa7a2-724b-4ef8-9c55-05c79827f806 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:43.364844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 656/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 05:06:43 2022] GET /identity/v3/role_assignments?user.id=5402629299ee411d988f130f03dbcfba&scope.project.id=35a66bcc751f400ca1a0f307f6bef50e&role.id=3508b429d46f4c67aa9e3cbb594e35e4 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:45.350272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588276-1ab9-4a77-8012-ac4fbf114cf4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:45.350786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588276-1ab9-4a77-8012-ac4fbf114cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:45.350879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588276-1ab9-4a77-8012-ac4fbf114cf4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:45.352222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 632/1288] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:45.357349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:45.357751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:45.357908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:45.376091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:45.377246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:45.405746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:45.441608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 657/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:45.464023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588276-1ab9-4a77-8012-ac4fbf114cf4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:45.563140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588276-1ab9-4a77-8012-ac4fbf114cf4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:45.574686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:45.597753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:45.598378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:45.598660 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:45.598934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:45.599590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:45.600945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:45.609903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:45.611071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:45.611999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 633/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:06:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:45.617028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:45.711103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238b0d-57f6-41cc-9d4a-720289e3f953 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:45.744275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:45.744858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:45.745132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:45.745398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:45.746049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:45.746343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:45.747726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbbf3-4203-42c6-937f-a28ee6aa3a72 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:45.752338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 658/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 05:06:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:45.757959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:45.871510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca2ed-f34f-4359-8df7-236129e145d8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:45.905496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:45.906102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:45.906381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:45.906654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:45.907343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:45.907650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:45.908996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04480d-219c-4f11-aaac-12d25a699cb8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:45.913296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 634/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 05:06:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:47.888863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e18b-1407-4b57-b4a8-fe72ef71cda3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:47.889398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e18b-1407-4b57-b4a8-fe72ef71cda3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:47.889398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e18b-1407-4b57-b4a8-fe72ef71cda3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:47.890749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 659/1293] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:47.895742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292470d9-493a-4966-aebb-4a1c890053a8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:47.896144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292470d9-493a-4966-aebb-4a1c890053a8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:47.896291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292470d9-493a-4966-aebb-4a1c890053a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:47.913850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-292470d9-493a-4966-aebb-4a1c890053a8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:47.915017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-292470d9-493a-4966-aebb-4a1c890053a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:47.943918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:47.982488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 635/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:48.005422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38e18b-1407-4b57-b4a8-fe72ef71cda3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:48.035251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:48.105421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38e18b-1407-4b57-b4a8-fe72ef71cda3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:48.138460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd181d5-e685-4f8f-a57e-4f0943ff7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:48.139111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd181d5-e685-4f8f-a57e-4f0943ff7cef None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:48.139378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd181d5-e685-4f8f-a57e-4f0943ff7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:48.139652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd181d5-e685-4f8f-a57e-4f0943ff7cef None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:48.140340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd181d5-e685-4f8f-a57e-4f0943ff7cef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:48.141707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd181d5-e685-4f8f-a57e-4f0943ff7cef None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:48.155886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 660/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 05:06:48 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:06:50.171824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81164a-068c-4b80-92a8-f8ec595bd1fd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:50.172255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81164a-068c-4b80-92a8-f8ec595bd1fd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:50.172365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81164a-068c-4b80-92a8-f8ec595bd1fd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:50.173699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 636/1296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:50.178837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:50.179285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:50.179408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:50.198446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:50.199633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:50.268363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 661/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 05:06:50.300490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81164a-068c-4b80-92a8-f8ec595bd1fd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:50.414529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81164a-068c-4b80-92a8-f8ec595bd1fd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:50.447106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:50.447693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:50.447967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:50.448241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:50.448844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:50.450191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:50.458705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:50.459973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:50.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 637/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:06:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:50.466381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:50.484172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:50.561150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da8075-a977-4735-bfaf-e2ebf28e7698 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:50.595542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:50.596145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:50.596424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:50.596695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:50.597355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] RBAC: Adding query filter params (name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:50.597653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:50.599003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:50.603943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 662/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 05:06:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:50.609984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:50.644759 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:50.713725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f1ba-0e42-4c68-b534-cd4a9411a354 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:50.745791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:50.746389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:50.746664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:50.746931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:50.747692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] RBAC: Adding query filter params (interface=public, service_id=efd7666f42504039a6927c4b6f3a4a66, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:50.747998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:50.749341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bb3d2-1e84-4a5c-94f1-b56a276776d2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:50.754159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 638/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 05:06:50 2022] GET /identity/v3/endpoints?service_id=efd7666f42504039a6927c4b6f3a4a66&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:50.760393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:50.848083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:50.868817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebadb0-f363-43af-8690-a316ca7a87af None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:50.902697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd267-5366-4545-9f61-6ae56313c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:50.903343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd267-5366-4545-9f61-6ae56313c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:50.903628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd267-5366-4545-9f61-6ae56313c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:50.903905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd267-5366-4545-9f61-6ae56313c2a7 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:50.904549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd267-5366-4545-9f61-6ae56313c2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:50.905924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd267-5366-4545-9f61-6ae56313c2a7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:50.912560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 663/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 05:06:50 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:06:52.898043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e559753-ddfd-4963-aa5b-474682ef4863 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:52.898597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e559753-ddfd-4963-aa5b-474682ef4863 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:52.898597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e559753-ddfd-4963-aa5b-474682ef4863 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:52.900481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 639/1302] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:06:52.905573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:52.905966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:52.906130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:52.924672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:06:52.925844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:06:52.990408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 664/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:06:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 05:06:53.013104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e559753-ddfd-4963-aa5b-474682ef4863 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:53.107580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:53.114702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e559753-ddfd-4963-aa5b-474682ef4863 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:53.146239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:53.146853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:53.147130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:53.147430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:53.148037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:53.149963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 05:06:53.158451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 05:06:53.159650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 05 05:06:53.160676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 640/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 05:06:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 05:06:53.167432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:53.239593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:53.262398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91b4fb-de9d-4df5-9329-5bf8587a17a1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:53.295697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:53.296299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:53.296578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:53.296847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:53.297509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:06:53.297806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:53.299180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251cae-7a07-4a30-87e3-4c5a8addbff1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:53.304124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 665/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 05:06:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:06:53.310473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:06:53.406434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a392fe9-7d02-44aa-b428-79a7db07c308 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:06:53.438895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce33f58-690d-4fe7-88f2-7a86e4fafe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:06:53.439511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33f58-690d-4fe7-88f2-7a86e4fafe97 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:06:53.439788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33f58-690d-4fe7-88f2-7a86e4fafe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:06:53.440058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33f58-690d-4fe7-88f2-7a86e4fafe97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:06:53.440753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce33f58-690d-4fe7-88f2-7a86e4fafe97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:06:53.442091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce33f58-690d-4fe7-88f2-7a86e4fafe97 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:06:53.461539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 641/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:06:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:07:03.301249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=30 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:03.457270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:56.200480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d86cd-eca9-4f94-bab5-92653a0976e0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:56.201391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d86cd-eca9-4f94-bab5-92653a0976e0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:56.201832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d86cd-eca9-4f94-bab5-92653a0976e0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:56.207144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 666/1307] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:07:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:07:56.208616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ea3b-2951-4bb1-a29f-43caf9b2a516 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:56.209046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ea3b-2951-4bb1-a29f-43caf9b2a516 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:56.209151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ea3b-2951-4bb1-a29f-43caf9b2a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:56.302228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d283ea3b-2951-4bb1-a29f-43caf9b2a516 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:07:56.303897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d283ea3b-2951-4bb1-a29f-43caf9b2a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:07:56.439516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 642/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:07:56.495390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad64f-ce5a-450d-9baf-0e7f12f8d268 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:56.495938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad64f-ce5a-450d-9baf-0e7f12f8d268 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:56.496426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad64f-ce5a-450d-9baf-0e7f12f8d268 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:56.498157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 667/1309] 10.222.0.27 () {54 vars in 965 bytes} [Fri Aug 5 05:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:07:56.507123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b63f-12fe-460b-8182-0e966ec07010 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:56.508102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b63f-12fe-460b-8182-0e966ec07010 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:56.508421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b63f-12fe-460b-8182-0e966ec07010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:56.686313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ca85b63f-12fe-460b-8182-0e966ec07010 None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:07:56.687481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca85b63f-12fe-460b-8182-0e966ec07010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:07:56.728432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:56.807873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 643/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Aug 5 05:07:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:07:56.816954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad64f-ce5a-450d-9baf-0e7f12f8d268 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:07:56.818676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e97ad64f-ce5a-450d-9baf-0e7f12f8d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:07:56.939354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad64f-ce5a-450d-9baf-0e7f12f8d268 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:07:57.019546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:07:57.020654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:57.021175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:57.021664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:57.024087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:07:57.082976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:57.148945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:07:57.150455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ce80e-a8eb-4a43-b648-865b9d00d791 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:07:57.174323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 668/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:07:59.527303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6ea1d-3984-46cb-92bc-eea6ad285d37 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:59.527807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6ea1d-3984-46cb-92bc-eea6ad285d37 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:59.527807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6ea1d-3984-46cb-92bc-eea6ad285d37 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:59.529129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 644/1312] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:07:59.534420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be272-81a8-4e64-9a31-6e2d4cb0d0f2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:59.534882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be272-81a8-4e64-9a31-6e2d4cb0d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:59.535041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be272-81a8-4e64-9a31-6e2d4cb0d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:59.605580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6e8be272-81a8-4e64-9a31-6e2d4cb0d0f2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:07:59.606766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6e8be272-81a8-4e64-9a31-6e2d4cb0d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:07:59.704132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 669/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:07:59.743237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6ea1d-3984-46cb-92bc-eea6ad285d37 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:07:59.744870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8cd6ea1d-3984-46cb-92bc-eea6ad285d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:07:59.860142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6ea1d-3984-46cb-92bc-eea6ad285d37 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:07:59.935548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:59.938292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:07:59.938991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:07:59.939476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:07:59.939913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:07:59.941686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:00.052481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:00.053970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7bdf0-6596-497b-ae22-907cf425e3e7 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:00.074202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 645/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:02.365507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390339a7-7a4b-4d88-9877-52da7b709032 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:02.366031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390339a7-7a4b-4d88-9877-52da7b709032 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:02.366118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390339a7-7a4b-4d88-9877-52da7b709032 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:02.367559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 670/1315] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:02.372517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cf2b2-764e-4a33-bcb7-fb3661831526 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:02.372890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cf2b2-764e-4a33-bcb7-fb3661831526 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:02.373057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cf2b2-764e-4a33-bcb7-fb3661831526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:02.438444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-502cf2b2-764e-4a33-bcb7-fb3661831526 None None] MFA Rules not processed for user `1a5557b8f0984687a1118a8e8229c0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:02.439610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-502cf2b2-764e-4a33-bcb7-fb3661831526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:02.492111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:02.536487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 646/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:02.577303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390339a7-7a4b-4d88-9877-52da7b709032 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:02.578834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-390339a7-7a4b-4d88-9877-52da7b709032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:02.589037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:02.680477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390339a7-7a4b-4d88-9877-52da7b709032 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:02.750604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:02.751137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:02.751443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:02.751708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:02.753300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:02.814761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:02.862579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:02.864052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410c9b-f5b3-46b9-ae38-f273feedf388 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:02.883061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 671/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:05.440383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8075-a6ce-48cc-a74a-167cd8bbf3ea None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:05.440911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8075-a6ce-48cc-a74a-167cd8bbf3ea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:05.440911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8075-a6ce-48cc-a74a-167cd8bbf3ea None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:05.442202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 647/1318] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:05.447812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9f90-2687-499a-ab28-2718646a405d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:05.448240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9f90-2687-499a-ab28-2718646a405d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:05.448377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9f90-2687-499a-ab28-2718646a405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:05.513295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-eced9f90-2687-499a-ab28-2718646a405d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:05.514483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eced9f90-2687-499a-ab28-2718646a405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:05.608091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 672/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:05.646913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8075-a6ce-48cc-a74a-167cd8bbf3ea None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:05.649071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ddab8075-a6ce-48cc-a74a-167cd8bbf3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:05.752413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8075-a6ce-48cc-a74a-167cd8bbf3ea None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:05.826855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:05.827490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:05.827770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:05.828038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:05.829643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:05.837583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:05.937525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:05.938940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f15881-0ca1-48c2-87dd-ad97bc390f5e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:05.958804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 648/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:08.630064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd226-905d-499a-af3b-6b088d3f44df None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:08.630591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd226-905d-499a-af3b-6b088d3f44df None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:08.630591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd226-905d-499a-af3b-6b088d3f44df None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:08.632650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 673/1321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:08.637890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3304c-350c-4434-a4a8-8c53daf69722 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:08.638337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3304c-350c-4434-a4a8-8c53daf69722 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:08.638433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3304c-350c-4434-a4a8-8c53daf69722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:08.705907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f5b3304c-350c-4434-a4a8-8c53daf69722 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:08.707086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f5b3304c-350c-4434-a4a8-8c53daf69722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:08.764135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:08.811002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 649/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:08.847070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd226-905d-499a-af3b-6b088d3f44df None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:08.848717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-35ffd226-905d-499a-af3b-6b088d3f44df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:08.869894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:08.961663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd226-905d-499a-af3b-6b088d3f44df None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:09.039209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:09.039827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:09.040109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:09.040380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:09.042017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:09.113327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:09.150816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:09.152319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb0f5-c2ba-4f77-a292-580f761cc905 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:09.172124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 674/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:11.239417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e159f-0894-4557-8113-fd778221f5f6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:11.239961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e159f-0894-4557-8113-fd778221f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:11.239961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e159f-0894-4557-8113-fd778221f5f6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:11.241514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 650/1324] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:11.246535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275faf5-0bb6-45e9-9b92-affec102c3ad None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:11.246950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275faf5-0bb6-45e9-9b92-affec102c3ad None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:11.247087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275faf5-0bb6-45e9-9b92-affec102c3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:11.312612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0275faf5-0bb6-45e9-9b92-affec102c3ad None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:11.313699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0275faf5-0bb6-45e9-9b92-affec102c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:11.410346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 675/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:11.446300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e159f-0894-4557-8113-fd778221f5f6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:11.447870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-036e159f-0894-4557-8113-fd778221f5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:11.551248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e159f-0894-4557-8113-fd778221f5f6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:11.623505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:11.624114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:11.624392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:11.624660 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:11.626285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:11.643981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:11.742466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:11.743915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39788e5f-74b8-4ddc-922c-b6ecea4443d6 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:11.762524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 651/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:13.848300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c1e0-4f77-44b9-8dff-ee8a83c57518 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:13.848852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c1e0-4f77-44b9-8dff-ee8a83c57518 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:13.848852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c1e0-4f77-44b9-8dff-ee8a83c57518 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:13.850766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 676/1327] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:13.856699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302070b-4383-415d-8178-62dc6da9c75a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:13.857222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302070b-4383-415d-8178-62dc6da9c75a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:13.857388 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302070b-4383-415d-8178-62dc6da9c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:13.925453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2302070b-4383-415d-8178-62dc6da9c75a None None] MFA Rules not processed for user `1a5557b8f0984687a1118a8e8229c0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:13.926638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2302070b-4383-415d-8178-62dc6da9c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:13.993851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:14.027252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 652/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:14.078851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d176dc-c573-4aeb-b929-60e74d442c81 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:14.079138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d176dc-c573-4aeb-b929-60e74d442c81 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:14.079433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d176dc-c573-4aeb-b929-60e74d442c81 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:14.080793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 677/1329] 10.222.0.27 () {54 vars in 965 bytes} [Fri Aug 5 05:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:14.086927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47def4bc-785e-4bd6-83ef-a52a2c3a2f44 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:14.087252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47def4bc-785e-4bd6-83ef-a52a2c3a2f44 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:14.087513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47def4bc-785e-4bd6-83ef-a52a2c3a2f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:14.170309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-47def4bc-785e-4bd6-83ef-a52a2c3a2f44 None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:14.171579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-47def4bc-785e-4bd6-83ef-a52a2c3a2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:14.250643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 653/1330] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Aug 5 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:14.260020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d176dc-c573-4aeb-b929-60e74d442c81 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:14.264242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-21d176dc-c573-4aeb-b929-60e74d442c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:14.294309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:14.372177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d176dc-c573-4aeb-b929-60e74d442c81 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:14.452148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:14.452774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:14.453059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:14.453335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:14.455000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:14.544776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:14.580993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:14.583428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c47614-ecbd-4d00-bbaa-913838b16928 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:14.603656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 678/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:08:17.264954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753a497-925e-479f-b14b-d8e469e38fee None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:17.265476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753a497-925e-479f-b14b-d8e469e38fee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:17.265476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753a497-925e-479f-b14b-d8e469e38fee None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:17.266825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 654/1332] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:17.273004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa8536-8542-4ab9-b7b6-d7dcdc27f4c6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:17.273444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa8536-8542-4ab9-b7b6-d7dcdc27f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:17.273541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa8536-8542-4ab9-b7b6-d7dcdc27f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:17.339375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9efa8536-8542-4ab9-b7b6-d7dcdc27f4c6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:17.340568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9efa8536-8542-4ab9-b7b6-d7dcdc27f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:17.435964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 679/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:17.471886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753a497-925e-479f-b14b-d8e469e38fee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:17.473403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d753a497-925e-479f-b14b-d8e469e38fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:17.543385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:17.577290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753a497-925e-479f-b14b-d8e469e38fee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:17.649070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:17.649673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:17.649950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:17.650220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:17.651846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:17.759845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:17.761196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54679ec-d905-4f6d-8b54-e9fb427222e5 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:17.771049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:17.779969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 655/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:19.818538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723f7a0-7104-45d4-943a-3cb22f200b61 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:19.819372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723f7a0-7104-45d4-943a-3cb22f200b61 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:19.819372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723f7a0-7104-45d4-943a-3cb22f200b61 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:19.820719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 680/1335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:19.826390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed4e6-f4f6-424e-850e-95f581b33ae8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:19.826768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed4e6-f4f6-424e-850e-95f581b33ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:19.826942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed4e6-f4f6-424e-850e-95f581b33ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:19.891725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-94bed4e6-f4f6-424e-850e-95f581b33ae8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:19.892921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-94bed4e6-f4f6-424e-850e-95f581b33ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:19.987644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 656/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:20.029810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723f7a0-7104-45d4-943a-3cb22f200b61 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:20.031400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7723f7a0-7104-45d4-943a-3cb22f200b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:20.071858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:20.134728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723f7a0-7104-45d4-943a-3cb22f200b61 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:20.207850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:20.209014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:20.209287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:20.209551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:20.211149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:20.299445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:20.324850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:20.326229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842ab25-0816-480d-8184-af1f9d812cb4 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:20.344000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 681/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:22.843822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a7c2-7068-4eb4-b6f9-8a175e590d2e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:22.844452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a7c2-7068-4eb4-b6f9-8a175e590d2e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:22.844452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a7c2-7068-4eb4-b6f9-8a175e590d2e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:22.845729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 657/1338] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:22.850927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f7bc-db90-464e-ae0f-67a6fdfd6147 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:22.851355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f7bc-db90-464e-ae0f-67a6fdfd6147 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:22.851527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f7bc-db90-464e-ae0f-67a6fdfd6147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:22.916215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2159f7bc-db90-464e-ae0f-67a6fdfd6147 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:22.917407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2159f7bc-db90-464e-ae0f-67a6fdfd6147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:23.014030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 682/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:23.050338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a7c2-7068-4eb4-b6f9-8a175e590d2e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:23.051960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20e4a7c2-7068-4eb4-b6f9-8a175e590d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:23.126674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:23.155460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a7c2-7068-4eb4-b6f9-8a175e590d2e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:23.233469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:23.234071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:23.234374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:23.234644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:23.236281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:23.345262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:23.346699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e2ae4-f5c9-47da-80e0-80972d254f61 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:23.365091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 658/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:27.393568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dee3f-2af5-4704-b4c6-9df8e1409240 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:27.394162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dee3f-2af5-4704-b4c6-9df8e1409240 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:27.394162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dee3f-2af5-4704-b4c6-9df8e1409240 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:27.396254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 683/1341] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:27.401410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518059-eacb-4ee8-8aa9-ee6d4d26b8f3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:27.401855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518059-eacb-4ee8-8aa9-ee6d4d26b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:27.401960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518059-eacb-4ee8-8aa9-ee6d4d26b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:27.407471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:27.469563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1e518059-eacb-4ee8-8aa9-ee6d4d26b8f3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:27.470677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e518059-eacb-4ee8-8aa9-ee6d4d26b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:27.565226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 659/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:27.604983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dee3f-2af5-4704-b4c6-9df8e1409240 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:27.606639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e5dee3f-2af5-4704-b4c6-9df8e1409240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:27.655676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:27.714003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dee3f-2af5-4704-b4c6-9df8e1409240 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:27.788586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:27.789113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:27.789391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:27.789658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:27.791300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:27.885564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:27.902967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:27.904457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac6c56-4afa-4e73-9e00-ffff97f5cdef service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:27.922905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 684/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:30.702422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1378-8647-4e19-a69a-3d3498481095 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:30.703010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1378-8647-4e19-a69a-3d3498481095 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:30.703010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1378-8647-4e19-a69a-3d3498481095 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:30.704501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 660/1344] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:30.710066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ea47-ebf6-4d09-8209-b7098aeb69fb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:30.710479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ea47-ebf6-4d09-8209-b7098aeb69fb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:30.710610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ea47-ebf6-4d09-8209-b7098aeb69fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:30.777692 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-05b4ea47-ebf6-4d09-8209-b7098aeb69fb None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:30.778897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-05b4ea47-ebf6-4d09-8209-b7098aeb69fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:30.875941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 685/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:30.914794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d1378-8647-4e19-a69a-3d3498481095 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:30.916297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca3d1378-8647-4e19-a69a-3d3498481095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:31.003839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:31.022564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d1378-8647-4e19-a69a-3d3498481095 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:31.106072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:31.106683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:31.106962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:31.107261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:31.108865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:31.221559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:31.222991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1a60-0a47-4ac4-9d62-4615c043e1b0 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:31.242174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 661/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:35.440366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0efe-8343-45c6-9c80-7e1c40ed81e0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:35.440910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0efe-8343-45c6-9c80-7e1c40ed81e0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:35.440910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0efe-8343-45c6-9c80-7e1c40ed81e0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:35.442862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 686/1347] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:35.448546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7db2-f086-4b51-a02d-023ebc58cb41 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:35.448986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7db2-f086-4b51-a02d-023ebc58cb41 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:35.449096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7db2-f086-4b51-a02d-023ebc58cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:35.465644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:35.521703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f67a7db2-f086-4b51-a02d-023ebc58cb41 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:35.522930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f67a7db2-f086-4b51-a02d-023ebc58cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:35.625794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 662/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:35.665457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0efe-8343-45c6-9c80-7e1c40ed81e0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:35.667001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c79f0efe-8343-45c6-9c80-7e1c40ed81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:35.747939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:35.804939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0efe-8343-45c6-9c80-7e1c40ed81e0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:35.882941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:35.883587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:35.883864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:35.884134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:35.885732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:35.997913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:36.002839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:36.004406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b3640-5dfd-4fd2-949c-eb4e2e7c5365 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:36.023294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 687/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:40.885301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50686-6ded-495c-b93c-76173ff922ae None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:40.886114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50686-6ded-495c-b93c-76173ff922ae None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:40.886554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50686-6ded-495c-b93c-76173ff922ae None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:40.888337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 663/1350] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:40.893858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060faff-84ca-4d65-b824-92fc74dd16c9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:40.894615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060faff-84ca-4d65-b824-92fc74dd16c9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:40.895351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060faff-84ca-4d65-b824-92fc74dd16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:41.017854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f060faff-84ca-4d65-b824-92fc74dd16c9 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:41.018954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f060faff-84ca-4d65-b824-92fc74dd16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:41.140407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 688/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:08:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:45.413904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2b6e-3f0e-4dd9-85ce-a41aaf7ea9fe None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:45.414457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2b6e-3f0e-4dd9-85ce-a41aaf7ea9fe None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:45.414457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2b6e-3f0e-4dd9-85ce-a41aaf7ea9fe None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:45.415992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 664/1352] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:45.420759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065965e-1b12-49d1-98d6-45795e93d708 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:45.421562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065965e-1b12-49d1-98d6-45795e93d708 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:45.422056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065965e-1b12-49d1-98d6-45795e93d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:45.483743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:45.510130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6065965e-1b12-49d1-98d6-45795e93d708 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:45.511786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6065965e-1b12-49d1-98d6-45795e93d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:45.624681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=59 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:45.639359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 689/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:08:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:46.829914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47e3f4-2d16-43bb-9be0-286cdb0636f0 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:46.830489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47e3f4-2d16-43bb-9be0-286cdb0636f0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:46.830647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47e3f4-2d16-43bb-9be0-286cdb0636f0 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:46.832142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 665/1354] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:46.837334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451ef1-f8c3-43d2-b122-5c69be6c4934 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:46.837755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451ef1-f8c3-43d2-b122-5c69be6c4934 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:46.837876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451ef1-f8c3-43d2-b122-5c69be6c4934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:46.912597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-79451ef1-f8c3-43d2-b122-5c69be6c4934 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:46.913769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-79451ef1-f8c3-43d2-b122-5c69be6c4934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:46.955456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:47.020867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 690/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:08:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:08:50.458644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fa8f-dcc1-48a4-9b57-c01eedbe05df None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:50.459510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fa8f-dcc1-48a4-9b57-c01eedbe05df None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:50.459956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fa8f-dcc1-48a4-9b57-c01eedbe05df None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:50.461762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 666/1356] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:50.467399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636b03-4880-47c8-bc7f-afc693e0c260 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:50.468318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636b03-4880-47c8-bc7f-afc693e0c260 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:50.468831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636b03-4880-47c8-bc7f-afc693e0c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:50.558810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d2636b03-4880-47c8-bc7f-afc693e0c260 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:50.560433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d2636b03-4880-47c8-bc7f-afc693e0c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:50.667017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 691/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:50.721510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8745-9b0e-4298-bed5-43373f2913f3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:50.722299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8745-9b0e-4298-bed5-43373f2913f3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:50.723578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8745-9b0e-4298-bed5-43373f2913f3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:50.725277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 667/1358] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 05:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:50.733533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca22c9-fe50-49b1-9b33-ce5e57fa2f4d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:50.733939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca22c9-fe50-49b1-9b33-ce5e57fa2f4d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:50.734495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca22c9-fe50-49b1-9b33-ce5e57fa2f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:50.754077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:50.818040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-56ca22c9-fe50-49b1-9b33-ce5e57fa2f4d None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:50.819767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-56ca22c9-fe50-49b1-9b33-ce5e57fa2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:50.945030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 692/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 05:08:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:50.952880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8745-9b0e-4298-bed5-43373f2913f3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:50.954463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a5f8745-9b0e-4298-bed5-43373f2913f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:51.108943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8745-9b0e-4298-bed5-43373f2913f3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:51.196283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:51.239999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:51.240624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:51.240910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:51.241187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:51.242983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:51.340582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:51.342262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bbbbf-b76c-44bf-b8e4-103ab1e8cb20 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:51.364918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 668/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:53.616838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072c047-d6eb-4bcb-bfd0-c7fab1925e29 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:53.617361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072c047-d6eb-4bcb-bfd0-c7fab1925e29 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:53.617361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072c047-d6eb-4bcb-bfd0-c7fab1925e29 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:53.618800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 693/1361] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:08:53.623889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5ef6-5eb3-48a9-899c-39569ba61d2a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:53.624330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5ef6-5eb3-48a9-899c-39569ba61d2a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:53.624509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5ef6-5eb3-48a9-899c-39569ba61d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:53.693555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7c3b5ef6-5eb3-48a9-899c-39569ba61d2a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:53.694745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7c3b5ef6-5eb3-48a9-899c-39569ba61d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:53.735856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:53.807445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 669/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:53.851768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072c047-d6eb-4bcb-bfd0-c7fab1925e29 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:53.853455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f072c047-d6eb-4bcb-bfd0-c7fab1925e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:53.930095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:54.026982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072c047-d6eb-4bcb-bfd0-c7fab1925e29 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:54.172274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:54.173621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:54.174114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:54.174604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:54.177401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:54.203504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:54.280445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:54.282097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcd26a-68de-45e2-bb56-6a9ca2b99ec7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:54.302561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 694/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:56.661798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48845fd6-d77e-4053-a368-d54d34ac7231 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:56.662330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48845fd6-d77e-4053-a368-d54d34ac7231 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:56.662445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48845fd6-d77e-4053-a368-d54d34ac7231 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:56.663864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 670/1364] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:56.669404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344499-5be6-4594-b2a3-c947fc89ca7a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:56.670251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344499-5be6-4594-b2a3-c947fc89ca7a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:56.670738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344499-5be6-4594-b2a3-c947fc89ca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:56.774020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-92344499-5be6-4594-b2a3-c947fc89ca7a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:56.775441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-92344499-5be6-4594-b2a3-c947fc89ca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:56.881609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:56.887206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 695/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:08:56.931783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e488b-2a5f-48f1-a73d-23d0d76a9f62 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:56.932387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e488b-2a5f-48f1-a73d-23d0d76a9f62 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:56.932790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e488b-2a5f-48f1-a73d-23d0d76a9f62 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:56.934413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 671/1366] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 05:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:56.939889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b6eb-9fcb-4854-89aa-06851d530b59 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:56.940180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b6eb-9fcb-4854-89aa-06851d530b59 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:56.940514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b6eb-9fcb-4854-89aa-06851d530b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:57.021752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0289b6eb-9fcb-4854-89aa-06851d530b59 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:57.022941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0289b6eb-9fcb-4854-89aa-06851d530b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:57.146257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 696/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 05:08:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:57.154638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e488b-2a5f-48f1-a73d-23d0d76a9f62 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:57.156160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-144e488b-2a5f-48f1-a73d-23d0d76a9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:57.324198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e488b-2a5f-48f1-a73d-23d0d76a9f62 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:57.345860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:57.447236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:57.447766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:57.448045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:57.448315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:57.449925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:57.547873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:57.549461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e803a-743b-426a-b982-fab6e3591f9c service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:57.571123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 672/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:08:58.569876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b4e2f-026b-411c-8ed6-ff0c8c35ecf9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:58.570433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b4e2f-026b-411c-8ed6-ff0c8c35ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:58.570433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b4e2f-026b-411c-8ed6-ff0c8c35ecf9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:58.572013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 697/1369] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:58.576985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b069c-3e1b-44ff-b735-1be2e143ac7e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:58.577438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b069c-3e1b-44ff-b735-1be2e143ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:58.577530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b069c-3e1b-44ff-b735-1be2e143ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:58.611386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:58.648331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-641b069c-3e1b-44ff-b735-1be2e143ac7e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:58.649529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-641b069c-3e1b-44ff-b735-1be2e143ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:58.750250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 673/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:59.101635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646ce2-2017-4cbf-884d-a98c96f10e66 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:59.101635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646ce2-2017-4cbf-884d-a98c96f10e66 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:59.101635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646ce2-2017-4cbf-884d-a98c96f10e66 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:59.103200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 698/1371] 10.222.0.27 () {54 vars in 964 bytes} [Fri Aug 5 05:08:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:59.108344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3d1a-bfc9-4162-8145-5131863657e5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:59.108750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3d1a-bfc9-4162-8145-5131863657e5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:59.109113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3d1a-bfc9-4162-8145-5131863657e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:59.191076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-241b3d1a-bfc9-4162-8145-5131863657e5 None None] MFA Rules not processed for user `27ec934145884311899c8ebd19082646`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:59.192327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-241b3d1a-bfc9-4162-8145-5131863657e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:59.248609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:59.282334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 674/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Aug 5 05:08:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:59.290718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646ce2-2017-4cbf-884d-a98c96f10e66 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:59.292706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e0646ce2-2017-4cbf-884d-a98c96f10e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:59.348563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:59.409212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646ce2-2017-4cbf-884d-a98c96f10e66 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:08:59.490544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:08:59.491176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:59.491477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:59.491753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:59.493510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:59.600531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:08:59.615670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:08:59.619673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc670e-ca1b-4875-b282-b78271eb0d75 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:08:59.643076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 699/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:08:59.682163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca642fe4-44dc-405b-bdd3-6286240acedd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:59.682707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca642fe4-44dc-405b-bdd3-6286240acedd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:59.682707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca642fe4-44dc-405b-bdd3-6286240acedd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:59.684539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 675/1374] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:08:59.689841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264172-0cb5-4fa2-a64a-778d5f10f049 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:08:59.690142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264172-0cb5-4fa2-a64a-778d5f10f049 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:08:59.690415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264172-0cb5-4fa2-a64a-778d5f10f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:08:59.759538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e7264172-0cb5-4fa2-a64a-778d5f10f049 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:08:59.761020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e7264172-0cb5-4fa2-a64a-778d5f10f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:08:59.875679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 700/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:08:59.917556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca642fe4-44dc-405b-bdd3-6286240acedd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:08:59.922560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca642fe4-44dc-405b-bdd3-6286240acedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:00.130932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca642fe4-44dc-405b-bdd3-6286240acedd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:00.182919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:00.244400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:00.245006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:00.245281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:00.245548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:00.247144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:00.338877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:00.340565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90e6fb-3fcb-4026-afb3-8929b913ff54 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:00.359970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 676/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:02.430393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b239-142a-4fd6-bba3-4866f87412e1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:02.430900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b239-142a-4fd6-bba3-4866f87412e1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:02.430900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b239-142a-4fd6-bba3-4866f87412e1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:02.432236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 701/1377] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:02.437290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b34510-f9ee-4e14-b05b-626c11d0837c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:02.437677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b34510-f9ee-4e14-b05b-626c11d0837c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:02.437844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b34510-f9ee-4e14-b05b-626c11d0837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:02.505108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-23b34510-f9ee-4e14-b05b-626c11d0837c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:02.506313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-23b34510-f9ee-4e14-b05b-626c11d0837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:02.513019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:02.613745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 677/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:02.658755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b239-142a-4fd6-bba3-4866f87412e1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:02.661441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ff50b239-142a-4fd6-bba3-4866f87412e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:02.729790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:02.842321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b239-142a-4fd6-bba3-4866f87412e1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:02.955349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:02.955971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:02.956851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:02.957399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:02.958984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:02.977324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:03.055881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:03.057425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac664fd-ca23-43b2-afee-0d6870ec7050 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:03.078613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 702/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:05.165253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2d3f-07ef-400a-8857-4b6fd346669b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:05.165757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2d3f-07ef-400a-8857-4b6fd346669b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:05.165757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2d3f-07ef-400a-8857-4b6fd346669b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:05.170999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 678/1380] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:05.172633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81864-ed49-4ff6-a6f7-09b55f565b9b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:05.177591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81864-ed49-4ff6-a6f7-09b55f565b9b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:05.177877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81864-ed49-4ff6-a6f7-09b55f565b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:05.251708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c2f81864-ed49-4ff6-a6f7-09b55f565b9b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:05.253897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c2f81864-ed49-4ff6-a6f7-09b55f565b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:05.354750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:05.362091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 703/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:05.408273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2d3f-07ef-400a-8857-4b6fd346669b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:05.410275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3b3c2d3f-07ef-400a-8857-4b6fd346669b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:05.558304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:05.570929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2d3f-07ef-400a-8857-4b6fd346669b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:05.692065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:05.692679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:05.692957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:05.693484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:05.695099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:05.790607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:05.792139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39884af-71c1-4f11-b53b-613ef6821ee5 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:05.805217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:05.816939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 679/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:08.052339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436250d-c249-410f-b71e-46a76164a4f9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:08.053016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436250d-c249-410f-b71e-46a76164a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:08.053016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436250d-c249-410f-b71e-46a76164a4f9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:08.054264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 704/1383] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:08.060807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6931e-28c7-4cb6-80a2-52b13b48b84b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:08.061253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6931e-28c7-4cb6-80a2-52b13b48b84b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:08.061523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6931e-28c7-4cb6-80a2-52b13b48b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:08.144301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-69d6931e-28c7-4cb6-80a2-52b13b48b84b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:08.145873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-69d6931e-28c7-4cb6-80a2-52b13b48b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:08.258850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 680/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:08.309273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436250d-c249-410f-b71e-46a76164a4f9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:08.310812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4436250d-c249-410f-b71e-46a76164a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:08.466495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436250d-c249-410f-b71e-46a76164a4f9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:08.544951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:08.598564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:08.599148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:08.599468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:08.599760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:08.601520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:08.695317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:08.696973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d5368-699a-40b5-a2d1-cc61caaa82da service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:08.715532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 705/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:10.757614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec6ed-0d42-4d1e-b13a-77b57217e23e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:10.758150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec6ed-0d42-4d1e-b13a-77b57217e23e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:10.758150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec6ed-0d42-4d1e-b13a-77b57217e23e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:10.759444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 681/1386] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:10.764790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fca55d-6424-4e60-90f0-7265504fbd3d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:10.765220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fca55d-6424-4e60-90f0-7265504fbd3d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:10.765436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fca55d-6424-4e60-90f0-7265504fbd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:10.834272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-79fca55d-6424-4e60-90f0-7265504fbd3d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:10.835484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-79fca55d-6424-4e60-90f0-7265504fbd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:10.869187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:10.945058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 706/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:10.999945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec6ed-0d42-4d1e-b13a-77b57217e23e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:11.001538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b1dec6ed-0d42-4d1e-b13a-77b57217e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:11.083146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:11.154909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec6ed-0d42-4d1e-b13a-77b57217e23e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:11.289127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:11.289753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:11.290037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:11.290311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:11.291987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:11.334754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:11.389077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:11.390757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e3f6-f559-4803-8445-44c8c5cee474 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:11.413735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 682/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:13.531456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f31415-9db5-4860-b406-a6b7f590d17f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:13.531955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f31415-9db5-4860-b406-a6b7f590d17f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:13.531955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f31415-9db5-4860-b406-a6b7f590d17f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:13.533300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 707/1389] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:13.539206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0388-e3fc-4e3a-91c2-342a985a376e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:13.539642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0388-e3fc-4e3a-91c2-342a985a376e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:13.539835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0388-e3fc-4e3a-91c2-342a985a376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:13.608312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b11d0388-e3fc-4e3a-91c2-342a985a376e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:13.609522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b11d0388-e3fc-4e3a-91c2-342a985a376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:13.711690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 683/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:13.755988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f31415-9db5-4860-b406-a6b7f590d17f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:13.757506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-01f31415-9db5-4860-b406-a6b7f590d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:13.904305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f31415-9db5-4860-b406-a6b7f590d17f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:13.920968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:14.020038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:14.020654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:14.020927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:14.021193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:14.022823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:14.115746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:14.117371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85632587-9b79-4e9f-b8a3-793e1465d85a service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:14.136025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 708/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:14.958766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ebc6c-1d43-4638-bd19-072044a1c2bb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:14.959341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ebc6c-1d43-4638-bd19-072044a1c2bb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:14.959341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ebc6c-1d43-4638-bd19-072044a1c2bb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:14.960858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 684/1392] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:14.965794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fdbdc-5a7e-4782-bf39-c7ed4995f633 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:14.966220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fdbdc-5a7e-4782-bf39-c7ed4995f633 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:14.966367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fdbdc-5a7e-4782-bf39-c7ed4995f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:14.992525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:15.033633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d76fdbdc-5a7e-4782-bf39-c7ed4995f633 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:15.034866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d76fdbdc-5a7e-4782-bf39-c7ed4995f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:15.130354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 709/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:15.186541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084685c-df73-4c31-a116-c672286efe24 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:15.186823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084685c-df73-4c31-a116-c672286efe24 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:15.187093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084685c-df73-4c31-a116-c672286efe24 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:15.188618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 685/1394] 10.222.0.27 () {54 vars in 966 bytes} [Fri Aug 5 05:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:15.193756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbfaf-3e1c-4fab-ac9c-4f0d30b052a0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:15.194044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbfaf-3e1c-4fab-ac9c-4f0d30b052a0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:15.194321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbfaf-3e1c-4fab-ac9c-4f0d30b052a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:15.270052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d7ebbfaf-3e1c-4fab-ac9c-4f0d30b052a0 None None] MFA Rules not processed for user `b35db16684ea4a4d9c6743bd3c094439`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:15.271140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d7ebbfaf-3e1c-4fab-ac9c-4f0d30b052a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:15.319720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:15.355666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 710/1395] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Aug 5 05:09:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:15.363382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084685c-df73-4c31-a116-c672286efe24 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:15.364879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9084685c-df73-4c31-a116-c672286efe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:15.379306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:15.473090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084685c-df73-4c31-a116-c672286efe24 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:15.547613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:15.548153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:15.548516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:15.548794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:15.550522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:15.618780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:15.661094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:15.662515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0790d7a-593b-4d7e-a91b-8b45073fe3d2 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:15.681026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 686/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:16.215260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9584-8d11-4a04-9b97-19285139b10e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.215771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9584-8d11-4a04-9b97-19285139b10e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.215862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9584-8d11-4a04-9b97-19285139b10e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.217448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 711/1397] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:16.223967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.224439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.224783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.301706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:16.302967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:16.410598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 687/1398] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:16.413799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb72cc-c887-47ef-9de6-faa8c536a4c3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.414249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb72cc-c887-47ef-9de6-faa8c536a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.414541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb72cc-c887-47ef-9de6-faa8c536a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.454791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:16.456507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:16.483927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:16.489650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-33eb72cc-c887-47ef-9de6-faa8c536a4c3 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:16.490868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-33eb72cc-c887-47ef-9de6-faa8c536a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:16.579581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 712/1399] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:09:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:16.585868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe680b2-44f8-401c-8434-c1ed86a9d2e3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:16.624841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259531fa-c92f-4120-82d2-20052de8eac7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.625123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259531fa-c92f-4120-82d2-20052de8eac7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.625394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259531fa-c92f-4120-82d2-20052de8eac7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.627048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 713/1400] 10.222.0.27 () {54 vars in 943 bytes} [Fri Aug 5 05:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:09:16.636486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.637202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.637475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.708727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:16.716689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] MFA Rules not processed for user `71f965b370df48a3a79ba0dd8a2ddf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:16.717900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:16.725214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:16.725826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.726124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.726378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.728120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:16.746820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:16.822995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:16.824635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7f8cc-a80f-4a86-8e70-e709a826d812 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:16.827448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 714/1401] 10.222.0.27 () {58 vars in 1040 bytes} [Fri Aug 5 05:09:16 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:16.838506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:16.843716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 688/1402] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:09:16.848273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc063-241b-4473-8559-f052a0c994b7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:16.959767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:16.960284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:16.960560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:16.960824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:16.962574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:16.965862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:17.055619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:17.057263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d221f2-7b1d-4ac3-ae1f-963481290812 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:17.065949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 715/1403] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 05:09:18.943783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86d27a-5276-4df6-9746-dddf7d51e5db None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:18.944396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86d27a-5276-4df6-9746-dddf7d51e5db None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:18.944396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86d27a-5276-4df6-9746-dddf7d51e5db None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:18.949471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 689/1404] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:18.950797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbbb6f-5c06-4816-b6a7-456279c348f9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:18.951246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbbb6f-5c06-4816-b6a7-456279c348f9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:18.951389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbbb6f-5c06-4816-b6a7-456279c348f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:19.026711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a1cbbb6f-5c06-4816-b6a7-456279c348f9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:19.027950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a1cbbb6f-5c06-4816-b6a7-456279c348f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:19.125060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:19.132997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 716/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:19.183659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86d27a-5276-4df6-9746-dddf7d51e5db None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:19.185413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-be86d27a-5276-4df6-9746-dddf7d51e5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:19.350732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:19.354066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86d27a-5276-4df6-9746-dddf7d51e5db None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:19.479098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:19.479740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:19.480022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:19.480296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:19.482064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:19.581656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:19.583437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42234f-b5e4-488e-ad36-1a25a6df1d3c service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:19.603027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 690/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:21.728040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675f40-df11-4aed-8793-3234feb32dd4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:21.728936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675f40-df11-4aed-8793-3234feb32dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:21.729212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675f40-df11-4aed-8793-3234feb32dd4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:21.730571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 717/1407] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:21.735922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3629b-ca2d-467e-9768-336ac112eae4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:21.736381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3629b-ca2d-467e-9768-336ac112eae4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:21.736480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3629b-ca2d-467e-9768-336ac112eae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:21.740980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:21.826126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4af3629b-ca2d-467e-9768-336ac112eae4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:21.827788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4af3629b-ca2d-467e-9768-336ac112eae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:21.953598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 691/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:21.999081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22675f40-df11-4aed-8793-3234feb32dd4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:22.000655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-22675f40-df11-4aed-8793-3234feb32dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:22.171740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22675f40-df11-4aed-8793-3234feb32dd4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:22.248998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:22.334587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:22.335634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:22.336122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:22.336616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:22.339831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:22.504658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:22.506239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b202de-920e-41fd-abf2-86655f7bc8c5 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:22.525791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 718/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:31.949584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=64 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:32.523146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=64 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:39.480374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a27be-fbc4-45c9-b303-a57237e6e681 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:39.480912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a27be-fbc4-45c9-b303-a57237e6e681 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:39.480912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a27be-fbc4-45c9-b303-a57237e6e681 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:39.482197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 692/1410] 10.222.0.27 () {54 vars in 918 bytes} [Fri Aug 5 05:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:39.487536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6dc90-73ae-4bc8-8f16-2364a8c96baf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:39.487962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6dc90-73ae-4bc8-8f16-2364a8c96baf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:39.488246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6dc90-73ae-4bc8-8f16-2364a8c96baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:39.563285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-63b6dc90-73ae-4bc8-8f16-2364a8c96baf None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:39.564500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63b6dc90-73ae-4bc8-8f16-2364a8c96baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:39.673471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 719/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Aug 5 05:09:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:39.688585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ef8c-1370-4edc-8222-6448912c420a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:39.688869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ef8c-1370-4edc-8222-6448912c420a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:39.689140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ef8c-1370-4edc-8222-6448912c420a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:39.690546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 693/1412] 10.222.0.27 () {54 vars in 918 bytes} [Fri Aug 5 05:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:39.695379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1579d-adcb-41e1-8c77-454683b0a08b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:39.695666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1579d-adcb-41e1-8c77-454683b0a08b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:39.695966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1579d-adcb-41e1-8c77-454683b0a08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:39.768914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:39.771099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-63a1579d-adcb-41e1-8c77-454683b0a08b None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:39.772953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63a1579d-adcb-41e1-8c77-454683b0a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:39.888876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 720/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Aug 5 05:09:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:42.359141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386e5b-8228-47fa-b740-b263717efc7f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:42.359703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386e5b-8228-47fa-b740-b263717efc7f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:42.359703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386e5b-8228-47fa-b740-b263717efc7f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:42.361052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:42.367048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e251d80-a81f-405b-95b5-2a90c79b993d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:42.367496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e251d80-a81f-405b-95b5-2a90c79b993d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:42.367658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e251d80-a81f-405b-95b5-2a90c79b993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:42.436529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7e251d80-a81f-405b-95b5-2a90c79b993d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:42.437727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e251d80-a81f-405b-95b5-2a90c79b993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:42.492798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:42.534385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:42.578277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386e5b-8228-47fa-b740-b263717efc7f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:42.580198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0d386e5b-8228-47fa-b740-b263717efc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:42.725187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386e5b-8228-47fa-b740-b263717efc7f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:42.803463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:42.843556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:42.844160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:42.844437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:42.844707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:42.846329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:42.933215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:42.934792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ecea-4406-4660-9101-5533f876d53e service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:42.952426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 695/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:43.845694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93687d9e-0141-4639-9bc6-f1fa96d51433 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:43.846262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93687d9e-0141-4639-9bc6-f1fa96d51433 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:43.846262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93687d9e-0141-4639-9bc6-f1fa96d51433 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:43.848297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:43.853476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdefd-8d3c-41cc-96f2-bfc174b8bd9c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:43.853934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdefd-8d3c-41cc-96f2-bfc174b8bd9c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:43.854039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdefd-8d3c-41cc-96f2-bfc174b8bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:43.931177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ed0cdefd-8d3c-41cc-96f2-bfc174b8bd9c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:43.932401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ed0cdefd-8d3c-41cc-96f2-bfc174b8bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:43.959094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:44.027886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:44.177968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93687d9e-0141-4639-9bc6-f1fa96d51433 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:44.179568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-93687d9e-0141-4639-9bc6-f1fa96d51433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:44.321389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93687d9e-0141-4639-9bc6-f1fa96d51433 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:44.360323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:44.431973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:44.432510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:44.432789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:44.433065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:44.434677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:44.522300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:44.523953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d86ea-9d0a-4ffa-989f-9e933dee4ac7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:44.542041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 723/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:45.423821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe60cb-eb9c-45f8-8eb7-97c27801db56 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:45.424352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe60cb-eb9c-45f8-8eb7-97c27801db56 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:45.424352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe60cb-eb9c-45f8-8eb7-97c27801db56 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:45.426358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:45.431453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c7d1-99f1-4118-8d18-ef276685ff62 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:45.431925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c7d1-99f1-4118-8d18-ef276685ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:45.432397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c7d1-99f1-4118-8d18-ef276685ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:45.490102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:45.512629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fd07c7d1-99f1-4118-8d18-ef276685ff62 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:45.513832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fd07c7d1-99f1-4118-8d18-ef276685ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:45.731702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:45.884825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe60cb-eb9c-45f8-8eb7-97c27801db56 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:45.886326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1abe60cb-eb9c-45f8-8eb7-97c27801db56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:46.029929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe60cb-eb9c-45f8-8eb7-97c27801db56 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:46.042467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:46.143787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:46.144393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:46.144670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:46.144935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:46.147127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:46.235274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:46.237335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0f36-b10c-40e4-8375-8c19631e2348 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:46.255569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 698/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:47.120265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906f390-e34f-4c5a-b7db-f5712c11b557 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:47.120839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906f390-e34f-4c5a-b7db-f5712c11b557 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:47.120839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906f390-e34f-4c5a-b7db-f5712c11b557 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:47.122193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:47.127274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96281b1c-ded5-46d9-baf8-354f3a60c7da None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:47.128216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96281b1c-ded5-46d9-baf8-354f3a60c7da None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:47.128318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96281b1c-ded5-46d9-baf8-354f3a60c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:47.148857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:47.207612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-96281b1c-ded5-46d9-baf8-354f3a60c7da None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:47.208797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-96281b1c-ded5-46d9-baf8-354f3a60c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:47.312479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:47.462752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906f390-e34f-4c5a-b7db-f5712c11b557 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:47.464213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8906f390-e34f-4c5a-b7db-f5712c11b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:47.573111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:47.608968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906f390-e34f-4c5a-b7db-f5712c11b557 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:47.720373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:47.720902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:47.721174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:47.721464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:47.723052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:47.796374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:47.813674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:47.815913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4f9f-0903-4ae1-a2a8-f4b4b8b772c4 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:47.834630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 726/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:48.710761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915039e-d59f-41fb-880b-de6564f83047 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:48.711348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915039e-d59f-41fb-880b-de6564f83047 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:48.711348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915039e-d59f-41fb-880b-de6564f83047 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:48.712695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:48.717533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62c71-b2c8-4561-afc4-2033cd381298 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:48.717933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62c71-b2c8-4561-afc4-2033cd381298 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:48.718082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62c71-b2c8-4561-afc4-2033cd381298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:48.793255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-42f62c71-b2c8-4561-afc4-2033cd381298 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:48.794444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-42f62c71-b2c8-4561-afc4-2033cd381298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:48.886749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:09:49.035765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915039e-d59f-41fb-880b-de6564f83047 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:49.037210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6915039e-d59f-41fb-880b-de6564f83047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:49.120883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:49.183302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915039e-d59f-41fb-880b-de6564f83047 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:49.293338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:49.293867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:49.294145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:49.294412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:49.296033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:49.343741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:49.385619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:49.387230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae292ecc-ed8d-4a9e-b89c-807c8d67c071 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:49.406171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 701/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:50.209469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0238a-f447-4db3-be8c-69fe51174369 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:50.209976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0238a-f447-4db3-be8c-69fe51174369 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:50.210076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0238a-f447-4db3-be8c-69fe51174369 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:50.211412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:50.216229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44cac-04e9-4df9-9759-a233b58778a2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:50.216658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44cac-04e9-4df9-9759-a233b58778a2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:50.216777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44cac-04e9-4df9-9759-a233b58778a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:50.293566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c0f44cac-04e9-4df9-9759-a233b58778a2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:50.294754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0f44cac-04e9-4df9-9759-a233b58778a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:50.390097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:50.543090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0238a-f447-4db3-be8c-69fe51174369 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:50.544544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dba0238a-f447-4db3-be8c-69fe51174369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:50.593350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:50.688137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0238a-f447-4db3-be8c-69fe51174369 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:50.797106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:50.797641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:50.797916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:50.798181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:50.800678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:50.808061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:50.888929 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:50.890512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f47e-950d-4490-96cf-b4fbcf7ec43a service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:50.907819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 729/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:51.706878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e837-74fc-48bc-bde1-5e38d224423c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:51.707487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e837-74fc-48bc-bde1-5e38d224423c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:51.707487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e837-74fc-48bc-bde1-5e38d224423c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:51.708824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:51.713606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c986-b88f-48c7-99ba-d0e3021c7c2e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:51.714030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c986-b88f-48c7-99ba-d0e3021c7c2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:51.714149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c986-b88f-48c7-99ba-d0e3021c7c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:51.791958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9fd5c986-b88f-48c7-99ba-d0e3021c7c2e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:51.793157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9fd5c986-b88f-48c7-99ba-d0e3021c7c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:51.860710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:51.890563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:52.042401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e837-74fc-48bc-bde1-5e38d224423c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:52.043993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-db66e837-74fc-48bc-bde1-5e38d224423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:52.061953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:52.195094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e837-74fc-48bc-bde1-5e38d224423c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:52.295182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:52.322066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:52.322677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:52.322957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:52.323265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:52.324884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:52.414787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:52.416416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91479ce-a768-4e8f-9509-e83fecb39829 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:52.435239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 704/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:53.239582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd944c-dc8e-43e6-a02c-acc67392ca89 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:53.240210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd944c-dc8e-43e6-a02c-acc67392ca89 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:53.240210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd944c-dc8e-43e6-a02c-acc67392ca89 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:53.241468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:53.246561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae880e-70c5-45fc-8162-3eef35fc0a93 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:53.247021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae880e-70c5-45fc-8162-3eef35fc0a93 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:53.247216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae880e-70c5-45fc-8162-3eef35fc0a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:53.323923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-44ae880e-70c5-45fc-8162-3eef35fc0a93 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:53.325132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-44ae880e-70c5-45fc-8162-3eef35fc0a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:53.366791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:53.421856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:53.572074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd944c-dc8e-43e6-a02c-acc67392ca89 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:53.573618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8fbd944c-dc8e-43e6-a02c-acc67392ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:53.717309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd944c-dc8e-43e6-a02c-acc67392ca89 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:53.770763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:53.827963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:53.828568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:53.828843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:53.829106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:53.831373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:53.917959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:53.919618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f0aa-3e56-4e8d-9b99-b587130d4785 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:53.937735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 732/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:54.739958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97d5c-9c4c-480f-84f0-f41220434cfe None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:54.740506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97d5c-9c4c-480f-84f0-f41220434cfe None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:54.740506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97d5c-9c4c-480f-84f0-f41220434cfe None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:54.741834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:54.746708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e17c2-c633-4b58-91cc-b6d190e71329 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:54.747099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e17c2-c633-4b58-91cc-b6d190e71329 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:54.747284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e17c2-c633-4b58-91cc-b6d190e71329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:54.828492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-722e17c2-c633-4b58-91cc-b6d190e71329 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:54.830567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-722e17c2-c633-4b58-91cc-b6d190e71329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:54.833076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:54.928338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:55.077595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b97d5c-9c4c-480f-84f0-f41220434cfe None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:55.079038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b2b97d5c-9c4c-480f-84f0-f41220434cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:55.227893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b97d5c-9c4c-480f-84f0-f41220434cfe None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:55.258587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:55.343480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:55.344022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:55.344297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:55.344568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:55.346678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:55.433811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:55.435427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d477312-0585-4b0e-9106-e1f64b660b3c service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:55.455246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 707/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:09:57.350712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472cea1-ac7e-4ee7-b2e1-005a89a792cb None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:57.351292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472cea1-ac7e-4ee7-b2e1-005a89a792cb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:57.351292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472cea1-ac7e-4ee7-b2e1-005a89a792cb None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:57.352690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:09:57.357915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97c92-216e-47fd-ac1c-12998433e594 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:57.358334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97c92-216e-47fd-ac1c-12998433e594 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:57.358466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97c92-216e-47fd-ac1c-12998433e594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:57.398985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:57.424863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f2e97c92-216e-47fd-ac1c-12998433e594 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:09:57.425992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f2e97c92-216e-47fd-ac1c-12998433e594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:57.648449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:09:57.686682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472cea1-ac7e-4ee7-b2e1-005a89a792cb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:09:57.688271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7472cea1-ac7e-4ee7-b2e1-005a89a792cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:57.794160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472cea1-ac7e-4ee7-b2e1-005a89a792cb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:09:57.827726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:09:57.868563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:09:57.869170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:09:57.869445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:09:57.869713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:09:57.871355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:09:57.977561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:09:57.978938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1fc98-d501-417f-acef-3ce2dc3ef833 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:09:57.996955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 735/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:00.167043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6c7f-a633-4529-af07-7aacf5979848 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:00.167593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6c7f-a633-4529-af07-7aacf5979848 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:00.167593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6c7f-a633-4529-af07-7aacf5979848 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:00.168892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:00.174205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359627-13cf-4d42-9045-14e365d0a8ce None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:00.175192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359627-13cf-4d42-9045-14e365d0a8ce None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:00.175377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359627-13cf-4d42-9045-14e365d0a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:00.240542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-01359627-13cf-4d42-9045-14e365d0a8ce None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:00.241740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-01359627-13cf-4d42-9045-14e365d0a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:00.254893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:00.336277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:00.375013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e6c7f-a633-4529-af07-7aacf5979848 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:00.376611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c50e6c7f-a633-4529-af07-7aacf5979848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:00.478397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e6c7f-a633-4529-af07-7aacf5979848 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:00.491049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:00.552661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:00.553260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:00.553534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:00.553800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:00.555416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:00.662023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:00.663472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849250b9-0ee5-450d-879f-762c2ae0c5ee service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:00.681705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 710/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:02.998840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c569b7-6095-4fe3-a9bc-bee2ae76db95 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:02.999418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c569b7-6095-4fe3-a9bc-bee2ae76db95 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:02.999516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c569b7-6095-4fe3-a9bc-bee2ae76db95 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:03.000814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:03.006530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e971-6c45-4c20-b48f-08c30545a1b6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:03.006957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e971-6c45-4c20-b48f-08c30545a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:03.007067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e971-6c45-4c20-b48f-08c30545a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:03.054626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:03.073503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-28f1e971-6c45-4c20-b48f-08c30545a1b6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:03.074712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-28f1e971-6c45-4c20-b48f-08c30545a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:03.171301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:03.210957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c569b7-6095-4fe3-a9bc-bee2ae76db95 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:03.212493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0c569b7-6095-4fe3-a9bc-bee2ae76db95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:03.311455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c569b7-6095-4fe3-a9bc-bee2ae76db95 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:03.350740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:03.384193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:03.384794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:03.385068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:03.385335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:03.386919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:03.492205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:03.493630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73ee72-2c0c-492a-984f-d461651a7842 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:03.510842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 738/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:05.696694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bc7bd-e206-42d1-9106-5dc05c5e2bab None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:05.697269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bc7bd-e206-42d1-9106-5dc05c5e2bab None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:05.697269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bc7bd-e206-42d1-9106-5dc05c5e2bab None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:05.698588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:05.703716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523c0e2-2fb2-403d-a8fc-e25665f3e78b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:05.704139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523c0e2-2fb2-403d-a8fc-e25665f3e78b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:05.704251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523c0e2-2fb2-403d-a8fc-e25665f3e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:05.770595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2523c0e2-2fb2-403d-a8fc-e25665f3e78b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:05.771833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2523c0e2-2fb2-403d-a8fc-e25665f3e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:05.791985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:05.870336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:05.909950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bc7bd-e206-42d1-9106-5dc05c5e2bab None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:05.911504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e73bc7bd-e206-42d1-9106-5dc05c5e2bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:06.013995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bc7bd-e206-42d1-9106-5dc05c5e2bab None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:06.034081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:06.087892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:06.088497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:06.088773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:06.089041 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:06.090646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:06.198425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:06.199874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92669f-0b74-4fef-81f0-5f1722e9527f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:06.217548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 713/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:08.266754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831158-49c8-4bf8-819b-1ed415c8ef2e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:08.267259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831158-49c8-4bf8-819b-1ed415c8ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:08.267368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831158-49c8-4bf8-819b-1ed415c8ef2e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:08.269229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:08.274320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5e68d-2da4-4ff0-a00e-dcaaf067e918 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:08.274715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5e68d-2da4-4ff0-a00e-dcaaf067e918 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:08.274862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5e68d-2da4-4ff0-a00e-dcaaf067e918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:08.337311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:08.340073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9ed5e68d-2da4-4ff0-a00e-dcaaf067e918 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:08.341788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9ed5e68d-2da4-4ff0-a00e-dcaaf067e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:08.435386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:08.473857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65831158-49c8-4bf8-819b-1ed415c8ef2e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:08.475452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65831158-49c8-4bf8-819b-1ed415c8ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:08.577444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65831158-49c8-4bf8-819b-1ed415c8ef2e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:08.625061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:08.650258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:08.650869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:08.651146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:08.651442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:08.653102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:08.759319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:08.760681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527b2e9-c097-4842-8ad7-a422afec3b1b service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:08.778807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 741/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:10.860031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d326-2dc5-41eb-b8c0-a50b48d107fd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:10.860602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d326-2dc5-41eb-b8c0-a50b48d107fd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:10.860602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d326-2dc5-41eb-b8c0-a50b48d107fd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:10.861951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:10.867375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529dee-cb5d-4c16-a195-ca250da3d99b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:10.867763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529dee-cb5d-4c16-a195-ca250da3d99b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:10.867928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529dee-cb5d-4c16-a195-ca250da3d99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:10.934037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-41529dee-cb5d-4c16-a195-ca250da3d99b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:10.935278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-41529dee-cb5d-4c16-a195-ca250da3d99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:10.965774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:11.034229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:11.073669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d326-2dc5-41eb-b8c0-a50b48d107fd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:11.075544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2b9d326-2dc5-41eb-b8c0-a50b48d107fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:11.181937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d326-2dc5-41eb-b8c0-a50b48d107fd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:11.211597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:11.258265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:11.258871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:11.259204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:11.259480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:11.261077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:11.370122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:11.371568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84746446-fbea-487d-91c6-da14295614c3 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:11.389515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 716/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:13.431615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42683f8-359a-4987-a9a8-71cf34c73597 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:13.432161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42683f8-359a-4987-a9a8-71cf34c73597 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:13.432161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42683f8-359a-4987-a9a8-71cf34c73597 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:13.433448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:13.438669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee614-a767-40fa-876c-5002c2a42af1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:13.439149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee614-a767-40fa-876c-5002c2a42af1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:13.439282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee614-a767-40fa-876c-5002c2a42af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:13.505612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-037ee614-a767-40fa-876c-5002c2a42af1 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:13.506806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-037ee614-a767-40fa-876c-5002c2a42af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:13.514941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:13.603755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:13.642688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42683f8-359a-4987-a9a8-71cf34c73597 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:13.644329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b42683f8-359a-4987-a9a8-71cf34c73597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:13.747964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42683f8-359a-4987-a9a8-71cf34c73597 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:13.802773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:13.822161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:13.822769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:13.823047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:13.823351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:13.824969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:13.931034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:13.932493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd4bf9-7eb2-4efb-9395-265b1ca0b9d2 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:13.951033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 744/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:15.992373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430295-0b6c-41ff-9507-b92abe156300 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:15.992945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430295-0b6c-41ff-9507-b92abe156300 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:15.992945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430295-0b6c-41ff-9507-b92abe156300 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:15.994289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:15.999616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76ea7-424a-42f6-93e1-877ade69aa14 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:15.999999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76ea7-424a-42f6-93e1-877ade69aa14 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:16.000159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76ea7-424a-42f6-93e1-877ade69aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:16.065984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-06f76ea7-424a-42f6-93e1-877ade69aa14 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:16.067180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06f76ea7-424a-42f6-93e1-877ade69aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:16.104789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:16.162759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:16.200556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6430295-0b6c-41ff-9507-b92abe156300 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:16.202071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b6430295-0b6c-41ff-9507-b92abe156300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:16.307048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6430295-0b6c-41ff-9507-b92abe156300 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:16.345016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:16.380888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:16.381492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:16.381767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:16.382032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:16.383643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:16.491198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:16.492624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ddd66-a813-4e48-a6c8-fc125f7edc48 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:16.510394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 719/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:18.566627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c750-0aac-4175-8d16-ec0b8cf2c8a1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:18.567142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c750-0aac-4175-8d16-ec0b8cf2c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:18.567142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c750-0aac-4175-8d16-ec0b8cf2c8a1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:18.568480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:18.573893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036ba23-f9c2-455f-aa22-d5b48704068f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:18.574304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036ba23-f9c2-455f-aa22-d5b48704068f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:18.574442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036ba23-f9c2-455f-aa22-d5b48704068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:18.640132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5036ba23-f9c2-455f-aa22-d5b48704068f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:18.641343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5036ba23-f9c2-455f-aa22-d5b48704068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:18.659911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:18.738354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:18.775270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39c750-0aac-4175-8d16-ec0b8cf2c8a1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:18.776803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5e39c750-0aac-4175-8d16-ec0b8cf2c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:18.878559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39c750-0aac-4175-8d16-ec0b8cf2c8a1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:18.945054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:18.952271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:18.952881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:18.953160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:18.953432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:18.955050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:19.062106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:19.063570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bedb2-d690-415f-acde-0b4e71b20c03 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:19.082506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 747/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:21.061318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7d12-3c82-405b-bf30-c343a7fb83f9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:21.061887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7d12-3c82-405b-bf30-c343a7fb83f9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:21.061887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7d12-3c82-405b-bf30-c343a7fb83f9 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:21.063316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:21.068486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6677-6c95-4138-b6d5-df6c34f566da None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:21.068897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6677-6c95-4138-b6d5-df6c34f566da None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:21.069032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6677-6c95-4138-b6d5-df6c34f566da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:21.134335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ae2a6677-6c95-4138-b6d5-df6c34f566da None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:21.135558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae2a6677-6c95-4138-b6d5-df6c34f566da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:21.186154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:21.235058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:21.271863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7d12-3c82-405b-bf30-c343a7fb83f9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:21.273444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-040d7d12-3c82-405b-bf30-c343a7fb83f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:21.377659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7d12-3c82-405b-bf30-c343a7fb83f9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:21.424554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:21.451376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:21.451983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:21.452289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:21.452558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:21.454194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:21.560643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:21.562055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a78a9-8e91-41b4-ab7f-aae8b88c2a5b service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:21.581258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 722/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:31.233428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=22 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:31.578343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=66 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:41.134534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962eab8-1c59-460c-a162-f945784a8219 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:41.135112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962eab8-1c59-460c-a162-f945784a8219 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:41.135112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962eab8-1c59-460c-a162-f945784a8219 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:41.136449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 749/1471] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:41.141868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1871e5-8481-4670-9635-0084312cee6f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:41.142412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1871e5-8481-4670-9635-0084312cee6f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:41.142571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1871e5-8481-4670-9635-0084312cee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:41.214359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9a1871e5-8481-4670-9635-0084312cee6f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:41.215581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a1871e5-8481-4670-9635-0084312cee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:41.310150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 723/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:41.393888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb77c1-ab9c-40ad-b9ca-a8acd86cdd85 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:41.394173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb77c1-ab9c-40ad-b9ca-a8acd86cdd85 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:41.394447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb77c1-ab9c-40ad-b9ca-a8acd86cdd85 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:41.395851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 750/1473] 10.222.0.27 () {54 vars in 966 bytes} [Fri Aug 5 05:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 05:10:41.400794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b6bd5-ff57-4a84-917d-ec12acb14738 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:41.401077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b6bd5-ff57-4a84-917d-ec12acb14738 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:41.401348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b6bd5-ff57-4a84-917d-ec12acb14738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:41.481506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f23b6bd5-ff57-4a84-917d-ec12acb14738 None None] MFA Rules not processed for user `b35db16684ea4a4d9c6743bd3c094439`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:41.482709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f23b6bd5-ff57-4a84-917d-ec12acb14738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:41.504255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:41.558098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 724/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Aug 5 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:41.566706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb77c1-ab9c-40ad-b9ca-a8acd86cdd85 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:41.568566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-31fb77c1-ab9c-40ad-b9ca-a8acd86cdd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:41.670182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb77c1-ab9c-40ad-b9ca-a8acd86cdd85 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:41.746094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:41.746699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:41.746972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:41.747262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:41.748866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:41.801625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:41.857043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:41.858481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62fb72-0939-462f-939b-a77e8a9f4ea6 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:41.877368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 751/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:43.966704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1fda5-7af7-40c6-a046-81be4eb0541b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:43.967389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1fda5-7af7-40c6-a046-81be4eb0541b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:43.967389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1fda5-7af7-40c6-a046-81be4eb0541b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:43.968615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 725/1476] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:43.974612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308fc93-1514-406b-bad2-bab3fb644ff4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:43.975052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308fc93-1514-406b-bad2-bab3fb644ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:43.975191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308fc93-1514-406b-bad2-bab3fb644ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:44.039902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4308fc93-1514-406b-bad2-bab3fb644ff4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:44.041119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4308fc93-1514-406b-bad2-bab3fb644ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:44.135106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 752/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:44.157250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1fda5-7af7-40c6-a046-81be4eb0541b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:44.159685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-32f1fda5-7af7-40c6-a046-81be4eb0541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:44.286213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1fda5-7af7-40c6-a046-81be4eb0541b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:44.334406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:44.378887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:44.379526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:44.379807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:44.380076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:44.380756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:44.382475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:10:44.382475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:10:44.382475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:10:44.383642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33116-6cee-49a3-8443-34ebc2561d7b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:44.402945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 726/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 05:10:44 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:10:46.413011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25641b15-08f9-4223-9470-ba79afe8623c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:46.413565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25641b15-08f9-4223-9470-ba79afe8623c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:46.413565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25641b15-08f9-4223-9470-ba79afe8623c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:46.414892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 753/1479] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:46.420198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80688b-66ed-4bed-8c1b-380006f110ca None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:46.420664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80688b-66ed-4bed-8c1b-380006f110ca None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:46.420789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80688b-66ed-4bed-8c1b-380006f110ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:46.486428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bf80688b-66ed-4bed-8c1b-380006f110ca None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:46.487673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf80688b-66ed-4bed-8c1b-380006f110ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:46.584004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 727/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:46.627978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25641b15-08f9-4223-9470-ba79afe8623c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:46.629615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-25641b15-08f9-4223-9470-ba79afe8623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:46.639535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:46.773139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25641b15-08f9-4223-9470-ba79afe8623c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:46.852674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:46.885362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:46.885975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:46.886280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:46.886552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:46.888221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:46.976225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:46.977820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9d877-49f4-4f1a-8dc4-e9f754592d30 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:46.995315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 754/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:10:49.157340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ee165-3275-48d1-84eb-18adb0850094 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:49.158410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ee165-3275-48d1-84eb-18adb0850094 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:49.158800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ee165-3275-48d1-84eb-18adb0850094 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:49.160206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 728/1482] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:49.165632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda839-f1b0-4bf4-81db-3e278b3fb4f7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:49.166068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda839-f1b0-4bf4-81db-3e278b3fb4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:49.166248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda839-f1b0-4bf4-81db-3e278b3fb4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:49.230506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cddda839-f1b0-4bf4-81db-3e278b3fb4f7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:49.231707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cddda839-f1b0-4bf4-81db-3e278b3fb4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:49.277040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:49.327701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 755/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:49.365120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ee165-3275-48d1-84eb-18adb0850094 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:49.366655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a86ee165-3275-48d1-84eb-18adb0850094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:49.389567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:49.469288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ee165-3275-48d1-84eb-18adb0850094 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:49.540419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:49.541015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:49.541291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:49.541554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:49.543139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:49.620349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:49.655439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:49.656874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3409f9-1758-4d81-849a-d9e0455b0f2f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:49.676066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 729/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:51.723702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a067b0-5874-4f32-bc3b-d99fba407775 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:51.724269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a067b0-5874-4f32-bc3b-d99fba407775 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:51.724269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a067b0-5874-4f32-bc3b-d99fba407775 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:51.725584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 756/1485] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:51.730685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d57ed-9178-4abe-975a-39704e5ca997 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:51.731176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d57ed-9178-4abe-975a-39704e5ca997 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:51.731296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d57ed-9178-4abe-975a-39704e5ca997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:51.797963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cc3d57ed-9178-4abe-975a-39704e5ca997 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:51.799869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cc3d57ed-9178-4abe-975a-39704e5ca997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:51.893927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 730/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:51.931491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a067b0-5874-4f32-bc3b-d99fba407775 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:51.933059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-10a067b0-5874-4f32-bc3b-d99fba407775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:52.034074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a067b0-5874-4f32-bc3b-d99fba407775 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:52.105044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:52.106831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:52.107484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:52.107975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:52.108460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:52.110333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:52.218193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:52.219663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dea790-26aa-4d81-b3f2-eb8221afc4cc service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:52.238331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 757/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:10:54.330280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50337a2-12ca-44be-97e5-f55c9d479ada None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:54.330788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50337a2-12ca-44be-97e5-f55c9d479ada None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:54.330903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50337a2-12ca-44be-97e5-f55c9d479ada None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:54.332211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 731/1488] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:54.337492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96623fc6-f43d-44e0-ab97-1754085e8e7b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:54.337881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96623fc6-f43d-44e0-ab97-1754085e8e7b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:54.338048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96623fc6-f43d-44e0-ab97-1754085e8e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:54.404045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-96623fc6-f43d-44e0-ab97-1754085e8e7b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:54.405272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-96623fc6-f43d-44e0-ab97-1754085e8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:54.457065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:54.500695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 758/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:10:54.542272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50337a2-12ca-44be-97e5-f55c9d479ada None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:54.543848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a50337a2-12ca-44be-97e5-f55c9d479ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:54.579890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:54.649106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50337a2-12ca-44be-97e5-f55c9d479ada None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:54.723329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:54.723870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:54.724160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:54.724438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:54.726332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:54.806957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:54.836378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:54.837785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187dda2-72d3-45d2-a5d1-f19887fa981e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:54.856871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 732/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:10:57.054400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b774-58bf-4828-a8e7-7bd5d5fbbea6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:57.054930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b774-58bf-4828-a8e7-7bd5d5fbbea6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:57.054930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b774-58bf-4828-a8e7-7bd5d5fbbea6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:57.056275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 759/1491] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 05:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:10:57.061519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b7f89-e75c-48e6-ba10-5a3a3ea1c6d0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:57.061958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b7f89-e75c-48e6-ba10-5a3a3ea1c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:57.062065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b7f89-e75c-48e6-ba10-5a3a3ea1c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:57.128736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-562b7f89-e75c-48e6-ba10-5a3a3ea1c6d0 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:10:57.129942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-562b7f89-e75c-48e6-ba10-5a3a3ea1c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:57.225856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 733/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:10:57.265338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b774-58bf-4828-a8e7-7bd5d5fbbea6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:10:57.266890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bce3b774-58bf-4828-a8e7-7bd5d5fbbea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:57.369345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b774-58bf-4828-a8e7-7bd5d5fbbea6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:10:57.439741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:10:57.440556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:10:57.440832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:10:57.441099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:10:57.442693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:10:57.452056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:10:57.549396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:10:57.550851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc53ea-87bc-4b7f-b4d1-a37b8c159517 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:10:57.568744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 760/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:11:07.224052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=82 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:11:07.566502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=50 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:07.560121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:07.560685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:07.560685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:07.636072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:12:07.637280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:07.736666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 734/1494] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:12:07.744999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:07.745482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:07.745585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:07.822317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:12:07.823461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:07.918704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 761/1495] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:12:07.923462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:07.924684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:07.936092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a96e-0398-45c9-be00-c6d3f3ef32e9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:07.997450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:08.031777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:08.032532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.032816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.033091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.033775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:12:08.034078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:08.035086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:08.035086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:12:08.035086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:12:08.036074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:08.047114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 735/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:12:08.055520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:08.065463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7f89e-4a69-45d2-96d4-0b217bdcbbac None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:08.126832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:08.160635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:08.161251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.161530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.161830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.162491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:08.164306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:08.164306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:12:08.164306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:12:08.165516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:08.221401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 762/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:12:08 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:12:08.225549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:08.227288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:08.261994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970cde-a5d8-45ea-9ced-c646835099ce admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:08.358048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:08.358658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.358942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.359251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.359909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:08.361542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:08.361542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:12:08.361542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:12:08.362754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:08.403780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 736/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:12:08 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:12:08.407913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:08.409462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:08.472543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112eb26-678d-4f80-a1ea-1841b9a5c390 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:08.556261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:08.568917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:08.569530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.569812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.570084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.571028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:08.572080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:08.572080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:12:08.572080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:12:08.572975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:08.585773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 763/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:12:08.589895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:08.591450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:08.603379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3125-ef75-4dc8-87fd-e084caac5a67 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:08.629881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:08.700069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:08.700590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.700865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.701132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.701803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:08.702794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:08.702794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:12:08.702794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:12:08.703704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686ebf-5bb1-4ae6-9529-cac4d854042b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:08.715937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 737/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:12:08.720825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:08.722333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:08.754974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2767be4-23a4-4912-ad8d-8d386b9d2c7c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:08.852089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:08.852750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.853027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.853296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] PATH_INFO: `/v3/projects/0b8fd0a88c6243788799ee94562ac8cd/users/8a21856c7225490185c2cd213f2723fb/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.875128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8fd0a88c6243788799ee94562ac8cd, user_id=8a21856c7225490185c2cd213f2723fb, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:08.876330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:08.876330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:12:08.876330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:12:08.878303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50a818-5fe0-4191-a0a1-d310e67ba06b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:08.901439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 764/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:12:08 2022] PUT /identity/v3/projects/0b8fd0a88c6243788799ee94562ac8cd/users/8a21856c7225490185c2cd213f2723fb/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:12:08.914092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e23d-2a03-417b-b7b2-bf8b8c20579d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:08.914391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e23d-2a03-417b-b7b2-bf8b8c20579d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:08.914661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e23d-2a03-417b-b7b2-bf8b8c20579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:08.972663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-20e3e23d-2a03-417b-b7b2-bf8b8c20579d None None] MFA Rules not processed for user `8a21856c7225490185c2cd213f2723fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:12:08.973800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20e3e23d-2a03-417b-b7b2-bf8b8c20579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:09.049677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 738/1502] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:12:09.062872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84da7d-7322-4999-8814-b988137cf859 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:09.063229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84da7d-7322-4999-8814-b988137cf859 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:09.063810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84da7d-7322-4999-8814-b988137cf859 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:09.064841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 765/1503] 10.222.0.27 () {54 vars in 964 bytes} [Fri Aug 5 05:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:12:09.069666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813a2f-ad83-420b-b683-03c7fc8dc6a1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:09.069953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813a2f-ad83-420b-b683-03c7fc8dc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:09.070224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813a2f-ad83-420b-b683-03c7fc8dc6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:09.102745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:09.148580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-59813a2f-ad83-420b-b683-03c7fc8dc6a1 None None] MFA Rules not processed for user `27ec934145884311899c8ebd19082646`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:12:09.149816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-59813a2f-ad83-420b-b683-03c7fc8dc6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:09.225721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 739/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Aug 5 05:12:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:12:09.233421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84da7d-7322-4999-8814-b988137cf859 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:09.234938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8a84da7d-7322-4999-8814-b988137cf859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:09.285473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:09.340420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84da7d-7322-4999-8814-b988137cf859 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:09.417800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:09.418413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:09.418698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:09.418970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:09.420636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:09.517015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:09.518371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:09.521759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:09.536517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 766/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:12:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:12:09.581508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8bcf-fc34-4158-b0fb-a230d0c21301 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:09.581887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8bcf-fc34-4158-b0fb-a230d0c21301 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:09.582175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8bcf-fc34-4158-b0fb-a230d0c21301 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:09.583485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 740/1506] 10.222.0.27 () {52 vars in 830 bytes} [Fri Aug 5 05:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:12:09.586960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:09.588176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:09.685338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8348b6-8601-4df4-8aec-202ee7382939 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:09.778115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:09.778746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:09.778922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:09.779221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] PATH_INFO: `/v3/users/8a21856c7225490185c2cd213f2723fb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:09.791341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a21856c7225490185c2cd213f2723fb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:09.792366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:09.792366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:12:09.792366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:12:09.793587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:09.803701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:09.863897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a21856c7225490185c2cd213f2723fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:09.864331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a21856c7225490185c2cd213f2723fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:09.864852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a21856c7225490185c2cd213f2723fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:09.887745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a21856c7225490185c2cd213f2723fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:09.896873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a21856c7225490185c2cd213f2723fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:09.915899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 767/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:12:09 2022] DELETE /identity/v3/users/8a21856c7225490185c2cd213f2723fb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:12:09.920298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3549-49e5-4535-be53-ff240b987aac None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:09.920774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3549-49e5-4535-be53-ff240b987aac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:09.920964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3549-49e5-4535-be53-ff240b987aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:09.978549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-064c3549-49e5-4535-be53-ff240b987aac None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:12:09.979772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-064c3549-49e5-4535-be53-ff240b987aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:10.055919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:10.068573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 741/1508] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:12:10.084797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:10.086041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:10.193402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad923f7-7b48-41b8-8b77-b3fc67253225 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:10.255086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:10.275516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:10.276144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:10.276405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:10.276673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:10.278285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:10.383786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:10.385272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f431080-066c-4046-919c-31610cad8c7e service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:10.404276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 768/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:12:10.734187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3549-49e5-4535-be53-ff240b987aac None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:12:10.735644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-064c3549-49e5-4535-be53-ff240b987aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:12:10.748340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3549-49e5-4535-be53-ff240b987aac None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:12:10.857328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:12:10.857880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:12:10.858157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:12:10.858425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] PATH_INFO: `/v3/projects/0b8fd0a88c6243788799ee94562ac8cd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:12:10.868306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8fd0a88c6243788799ee94562ac8cd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:12:10.869322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:12:10.869322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:12:10.869322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:12:10.870514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:12:10.927187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8fd0a88c6243788799ee94562ac8cd', 'request_id': 'req-266a97eb-f68f-4457-a59c-6e9567c1d564'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:10.933028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8fd0a88c6243788799ee94562ac8cd', 'request_id': 'req-266a97eb-f68f-4457-a59c-6e9567c1d564'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:10.946628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8fd0a88c6243788799ee94562ac8cd', 'request_id': 'req-266a97eb-f68f-4457-a59c-6e9567c1d564'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:10.972752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] The token cache is being invalidate because project 0b8fd0a88c6243788799ee94562ac8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:12:10.973034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:10.973453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-266a97eb-f68f-4457-a59c-6e9567c1d564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:12:10.974852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 742/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:12:10 2022] DELETE /identity/v3/projects/0b8fd0a88c6243788799ee94562ac8cd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:12:20.401789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=62 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:20.970713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:45.436636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533051c-009c-4b45-9d95-b81f81060050 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:45.437708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533051c-009c-4b45-9d95-b81f81060050 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:45.437708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533051c-009c-4b45-9d95-b81f81060050 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:45.439045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:13:45.443930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91aac-68a2-4630-b6e4-8aba1db44f2f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:45.444369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91aac-68a2-4630-b6e4-8aba1db44f2f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:45.444475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91aac-68a2-4630-b6e4-8aba1db44f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:45.525597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dcf91aac-68a2-4630-b6e4-8aba1db44f2f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:13:45.526795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dcf91aac-68a2-4630-b6e4-8aba1db44f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:45.629878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:13:45.788435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533051c-009c-4b45-9d95-b81f81060050 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:13:45.790519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b533051c-009c-4b45-9d95-b81f81060050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:45.913919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533051c-009c-4b45-9d95-b81f81060050 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:13:45.919384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a22f4-66ad-4f90-8048-85f0dd02b133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:13:45.919996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a22f4-66ad-4f90-8048-85f0dd02b133 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:45.920280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a22f4-66ad-4f90-8048-85f0dd02b133 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:45.920557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a22f4-66ad-4f90-8048-85f0dd02b133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:45.929154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a22f4-66ad-4f90-8048-85f0dd02b133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:13:45.930747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a22f4-66ad-4f90-8048-85f0dd02b133 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:13:45.940574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 770/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:13:46.768623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167daafe-ebeb-4164-988b-309d2f27fe59 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:46.769196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167daafe-ebeb-4164-988b-309d2f27fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:46.769196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167daafe-ebeb-4164-988b-309d2f27fe59 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:46.770504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:13:46.775214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811c67-0b5c-4191-9de5-a21d8496a1fa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:46.775688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811c67-0b5c-4191-9de5-a21d8496a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:46.775791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811c67-0b5c-4191-9de5-a21d8496a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:46.795260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-62811c67-0b5c-4191-9de5-a21d8496a1fa None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:13:46.797065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-62811c67-0b5c-4191-9de5-a21d8496a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:46.804770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:13:46.957440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167daafe-ebeb-4164-988b-309d2f27fe59 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:13:46.972375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167daafe-ebeb-4164-988b-309d2f27fe59 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:13:46.977731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517091-d236-4de2-b5c2-2797f8fb7991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:13:46.978328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517091-d236-4de2-b5c2-2797f8fb7991 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:46.978609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517091-d236-4de2-b5c2-2797f8fb7991 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:46.978896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517091-d236-4de2-b5c2-2797f8fb7991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:46.987834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517091-d236-4de2-b5c2-2797f8fb7991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:13:46.989429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517091-d236-4de2-b5c2-2797f8fb7991 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:13:46.999573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 745/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:13:47.027405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842530-b189-4fc8-bc9e-e861ef841328 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:47.027710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842530-b189-4fc8-bc9e-e861ef841328 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:47.028051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842530-b189-4fc8-bc9e-e861ef841328 None None] PATH_INFO: `/v3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:47.029404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 772/1517] 10.222.0.15 () {54 vars in 925 bytes} [Fri Aug 5 05:13:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:13:47.052555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d5e4-4bf7-4007-9c5a-7ddac7b9f2e7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:47.052839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d5e4-4bf7-4007-9c5a-7ddac7b9f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:47.053112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d5e4-4bf7-4007-9c5a-7ddac7b9f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:47.116662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f9f7d5e4-4bf7-4007-9c5a-7ddac7b9f2e7 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:13:47.117862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f9f7d5e4-4bf7-4007-9c5a-7ddac7b9f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:47.134913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:47.190085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 746/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 5 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:13:56.022590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf41e7-c9bd-4c58-9b82-2a86f7424634 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:56.023207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf41e7-c9bd-4c58-9b82-2a86f7424634 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:56.023207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf41e7-c9bd-4c58-9b82-2a86f7424634 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:56.024403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 773/1519] 10.222.0.27 () {54 vars in 961 bytes} [Fri Aug 5 05:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:13:56.029730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc84a5f-ca02-4064-ba38-86981dd51fc7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:56.030157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc84a5f-ca02-4064-ba38-86981dd51fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:56.030266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc84a5f-ca02-4064-ba38-86981dd51fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:56.050626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7cc84a5f-ca02-4064-ba38-86981dd51fc7 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:13:56.051841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7cc84a5f-ca02-4064-ba38-86981dd51fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:56.060331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 747/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Aug 5 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:13:56.067835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf41e7-c9bd-4c58-9b82-2a86f7424634 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:13:56.081171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf41e7-c9bd-4c58-9b82-2a86f7424634 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:13:56.086081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7573c-aaf9-47de-9449-d2d297158cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:13:56.086685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7573c-aaf9-47de-9449-d2d297158cd5 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:56.086967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7573c-aaf9-47de-9449-d2d297158cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:56.087267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7573c-aaf9-47de-9449-d2d297158cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:56.096155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7573c-aaf9-47de-9449-d2d297158cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:13:56.097819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7573c-aaf9-47de-9449-d2d297158cd5 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:13:56.107260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 774/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:13:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:13:58.217392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d89d-a5bf-4a86-8671-2023085a9c0e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:58.217904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d89d-a5bf-4a86-8671-2023085a9c0e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:58.218039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d89d-a5bf-4a86-8671-2023085a9c0e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:58.219345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:13:58.224078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a99df-eeaa-4e24-bfd1-4a715df56e00 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:58.224534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a99df-eeaa-4e24-bfd1-4a715df56e00 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:58.224639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a99df-eeaa-4e24-bfd1-4a715df56e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:58.243914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fc6a99df-eeaa-4e24-bfd1-4a715df56e00 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:13:58.245125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fc6a99df-eeaa-4e24-bfd1-4a715df56e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:58.253796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:13:58.407909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d89d-a5bf-4a86-8671-2023085a9c0e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:13:58.424460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d89d-a5bf-4a86-8671-2023085a9c0e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:13:58.429931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3903a7-bf06-4f9a-8c5a-9d1d3a3ec980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:13:58.430534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3903a7-bf06-4f9a-8c5a-9d1d3a3ec980 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:58.430817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3903a7-bf06-4f9a-8c5a-9d1d3a3ec980 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:58.431091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3903a7-bf06-4f9a-8c5a-9d1d3a3ec980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:58.440050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3903a7-bf06-4f9a-8c5a-9d1d3a3ec980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:13:58.441632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3903a7-bf06-4f9a-8c5a-9d1d3a3ec980 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:13:58.451394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 749/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:13:59.271577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df2e3-e8ca-4114-8315-266aab17882e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:59.272147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df2e3-e8ca-4114-8315-266aab17882e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:59.272147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df2e3-e8ca-4114-8315-266aab17882e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:59.273492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 05:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:13:59.278174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f296b-540a-453a-9139-dd879cc5a54c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:59.278566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f296b-540a-453a-9139-dd879cc5a54c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:59.278725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f296b-540a-453a-9139-dd879cc5a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:59.301128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e13f296b-540a-453a-9139-dd879cc5a54c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:13:59.302356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e13f296b-540a-453a-9139-dd879cc5a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:13:59.310363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 05:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:13:59.464337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df2e3-e8ca-4114-8315-266aab17882e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:13:59.479055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df2e3-e8ca-4114-8315-266aab17882e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:13:59.485299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160841b-b150-4249-a8ae-7c8c4437b34a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:13:59.485904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160841b-b150-4249-a8ae-7c8c4437b34a service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:13:59.486182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160841b-b150-4249-a8ae-7c8c4437b34a service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:13:59.486457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160841b-b150-4249-a8ae-7c8c4437b34a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:13:59.494544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160841b-b150-4249-a8ae-7c8c4437b34a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:13:59.496154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160841b-b150-4249-a8ae-7c8c4437b34a service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:13:59.505419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 777/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:14:03.406925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735bc4c-8a0a-460a-8492-cf45da14fa8e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:03.407515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735bc4c-8a0a-460a-8492-cf45da14fa8e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:03.407515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735bc4c-8a0a-460a-8492-cf45da14fa8e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:03.408891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:14:03.414115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3b3d-84fc-4968-bc10-1860b67de686 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:03.414553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3b3d-84fc-4968-bc10-1860b67de686 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:03.414649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3b3d-84fc-4968-bc10-1860b67de686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:03.434645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-009c3b3d-84fc-4968-bc10-1860b67de686 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:14:03.435849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-009c3b3d-84fc-4968-bc10-1860b67de686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:03.444316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:14:03.524336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735bc4c-8a0a-460a-8492-cf45da14fa8e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:14:03.526185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f735bc4c-8a0a-460a-8492-cf45da14fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:03.608098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735bc4c-8a0a-460a-8492-cf45da14fa8e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:14:03.611974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6282-aa14-4cfd-a335-8e76107d5d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:14:03.612586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6282-aa14-4cfd-a335-8e76107d5d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:03.612866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6282-aa14-4cfd-a335-8e76107d5d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:03.613138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6282-aa14-4cfd-a335-8e76107d5d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:03.622425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6282-aa14-4cfd-a335-8e76107d5d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:14:03.623878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6282-aa14-4cfd-a335-8e76107d5d1a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:14:03.633862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 752/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:14:05.696140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96206e-6926-4c9c-8dde-04b40d562c57 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:05.696679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96206e-6926-4c9c-8dde-04b40d562c57 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:05.696679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96206e-6926-4c9c-8dde-04b40d562c57 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:05.698040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:14:05.703234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32c87-4f85-4127-b7f0-bf352ed8ce42 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:05.704266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32c87-4f85-4127-b7f0-bf352ed8ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:05.704364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32c87-4f85-4127-b7f0-bf352ed8ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:05.724528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bca32c87-4f85-4127-b7f0-bf352ed8ce42 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:14:05.725718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bca32c87-4f85-4127-b7f0-bf352ed8ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:05.733506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:14:05.769470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96206e-6926-4c9c-8dde-04b40d562c57 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:14:05.780404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96206e-6926-4c9c-8dde-04b40d562c57 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:14:05.783974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d86cb-2938-44b4-8ea3-b6cc7bef7e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:14:05.784574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d86cb-2938-44b4-8ea3-b6cc7bef7e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:05.784854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d86cb-2938-44b4-8ea3-b6cc7bef7e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:05.785129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d86cb-2938-44b4-8ea3-b6cc7bef7e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:05.793877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d86cb-2938-44b4-8ea3-b6cc7bef7e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:14:05.795334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d86cb-2938-44b4-8ea3-b6cc7bef7e21 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:14:05.804869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 780/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:14:09.398257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2aa2-1063-47b7-ad45-295eb0315786 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:09.398814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2aa2-1063-47b7-ad45-295eb0315786 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:09.398814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2aa2-1063-47b7-ad45-295eb0315786 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:09.400171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:14:09.405498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf8f02-9792-4165-b47a-0e9f808ad3d9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:09.405943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf8f02-9792-4165-b47a-0e9f808ad3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:09.406043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf8f02-9792-4165-b47a-0e9f808ad3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:09.425926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-aabf8f02-9792-4165-b47a-0e9f808ad3d9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:14:09.427033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-aabf8f02-9792-4165-b47a-0e9f808ad3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:09.434683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:14:09.737987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2aa2-1063-47b7-ad45-295eb0315786 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:14:09.739671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-88db2aa2-1063-47b7-ad45-295eb0315786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:09.804923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:09.819915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2aa2-1063-47b7-ad45-295eb0315786 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:14:09.823983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe463f1e-ff05-4ff8-92ca-05cd5144f2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:14:09.824653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463f1e-ff05-4ff8-92ca-05cd5144f2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:09.825043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463f1e-ff05-4ff8-92ca-05cd5144f2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:09.825354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463f1e-ff05-4ff8-92ca-05cd5144f2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:09.835450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe463f1e-ff05-4ff8-92ca-05cd5144f2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:14:09.836866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe463f1e-ff05-4ff8-92ca-05cd5144f2f0 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:14:09.846870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 755/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:14:11.863583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6786-b7e3-4ab4-8272-5b4c013b2814 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:11.864152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6786-b7e3-4ab4-8272-5b4c013b2814 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:11.864152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6786-b7e3-4ab4-8272-5b4c013b2814 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:11.865487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 05:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:14:11.870602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ddd0e-93b2-4515-8c66-a08a5bf79d68 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:11.871048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ddd0e-93b2-4515-8c66-a08a5bf79d68 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:11.871179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ddd0e-93b2-4515-8c66-a08a5bf79d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:11.891636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-081ddd0e-93b2-4515-8c66-a08a5bf79d68 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:14:11.892813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-081ddd0e-93b2-4515-8c66-a08a5bf79d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:11.900768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 05:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:14:12.203338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e6786-b7e3-4ab4-8272-5b4c013b2814 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:14:12.205320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d25e6786-b7e3-4ab4-8272-5b4c013b2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:14:12.212814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:12.219888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e6786-b7e3-4ab4-8272-5b4c013b2814 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:14:12.225467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4188-d6e0-4ce2-93e1-79ca4e478dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:14:12.226076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4188-d6e0-4ce2-93e1-79ca4e478dff service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:14:12.226357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4188-d6e0-4ce2-93e1-79ca4e478dff service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:14:12.226634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4188-d6e0-4ce2-93e1-79ca4e478dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:14:12.236412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4188-d6e0-4ce2-93e1-79ca4e478dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:14:12.237857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4188-d6e0-4ce2-93e1-79ca4e478dff service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:14:12.247200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 783/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:14:21.886737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=11 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:22.243010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:39.416843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.417501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.417501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.447019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:39.448642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:39.461187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 757/1540] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:39.470404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.471016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.471016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.504811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:39.506300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:39.518917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 784/1541] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:39.523716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:39.539228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b66ff-a5cb-43c0-8a9c-299a4a8ddf5a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:39.550736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:39.551401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.551701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.551955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.552657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:39.552959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:39.554567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:39.572871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 758/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:39.582310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:39.598588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1ad1f-2903-42ef-9214-66e250c92651 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:39.612264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:39.612903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.613188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.613459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.614143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:39.617220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:39.686484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 785/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:39.691483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:39.703143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854289c-921f-48e1-b744-07f1315d9202 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:39.787722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3fb34-8e1c-48c8-ace7-135f3d1ac9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:39.788355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb34-8e1c-48c8-ace7-135f3d1ac9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.788642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb34-8e1c-48c8-ace7-135f3d1ac9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.788973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb34-8e1c-48c8-ace7-135f3d1ac9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.789648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3fb34-8e1c-48c8-ace7-135f3d1ac9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:39.791613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3fb34-8e1c-48c8-ace7-135f3d1ac9a4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:39.830476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 759/1544] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:39.834996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:39.838953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.839267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.839554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.850393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc27a8-b157-4577-86e0-bb1b5a96b889 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:39.860636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee52093-0d01-4ecd-9c59-a9fc958ce6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:39.861295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52093-0d01-4ecd-9c59-a9fc958ce6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.861579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52093-0d01-4ecd-9c59-a9fc958ce6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.861882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52093-0d01-4ecd-9c59-a9fc958ce6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.862638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee52093-0d01-4ecd-9c59-a9fc958ce6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:39.864487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee52093-0d01-4ecd-9c59-a9fc958ce6f8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:39.879036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:39.880612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:39.886632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 786/1545] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:39.886632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb5061-ec55-4565-a494-0891485c2d45 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.887520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb5061-ec55-4565-a494-0891485c2d45 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.887810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb5061-ec55-4565-a494-0891485c2d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.905619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 760/1546] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:39.906787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:39.920380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5ffb5061-ec55-4565-a494-0891485c2d45 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:39.921570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5ffb5061-ec55-4565-a494-0891485c2d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:39.922346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8adde-a1c6-436a-9623-fa99438dca2c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:39.934482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1594d-3237-43d8-b2d7-2ee0ff20c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:39.935984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 787/1547] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:39.936241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1594d-3237-43d8-b2d7-2ee0ff20c965 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.936707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1594d-3237-43d8-b2d7-2ee0ff20c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.937202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1594d-3237-43d8-b2d7-2ee0ff20c965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.937319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773860e-f18f-415a-99b8-96f3c4671b08 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.937484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773860e-f18f-415a-99b8-96f3c4671b08 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.937762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773860e-f18f-415a-99b8-96f3c4671b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.938732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1594d-3237-43d8-b2d7-2ee0ff20c965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:39.944612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1594d-3237-43d8-b2d7-2ee0ff20c965 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:39.959542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9773860e-f18f-415a-99b8-96f3c4671b08 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:39.960680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9773860e-f18f-415a-99b8-96f3c4671b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:39.962727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 761/1548] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:39.967791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.968610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.969269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:39.979132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 788/1549] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:39.980598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f174-f090-4603-878c-fdd73ba52dfd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:39.980950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f174-f090-4603-878c-fdd73ba52dfd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:39.981235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f174-f090-4603-878c-fdd73ba52dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.008807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.011250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.021177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6437f174-f090-4603-878c-fdd73ba52dfd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.023607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6437f174-f090-4603-878c-fdd73ba52dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.030288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 762/1550] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.031982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.043711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 789/1551] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.046286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a14203-09b4-4a0e-966f-7110268d8c25 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.048203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a14203-09b4-4a0e-966f-7110268d8c25 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.050190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a14203-09b4-4a0e-966f-7110268d8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.053719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2688cbe-8d36-40b4-af4e-b8cf83f025d9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.064390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.065370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.065860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.066331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] PATH_INFO: `/v3/projects/c49ab6059ec643e5b702cd79662d2531/users/43145493670d4969a0739063f90fdd8a/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.082722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b7a14203-09b4-4a0e-966f-7110268d8c25 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.084031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b7a14203-09b4-4a0e-966f-7110268d8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.089120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49ab6059ec643e5b702cd79662d2531, user_id=43145493670d4969a0739063f90fdd8a, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.090268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:15:40.090268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:15:40.090268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:15:40.092740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.093145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 790/1552] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.094355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.094641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.094913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.113434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 763/1553] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:40 2022] PUT /identity/v3/projects/c49ab6059ec643e5b702cd79662d2531/users/43145493670d4969a0739063f90fdd8a/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:40.114736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.121542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.123547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.190314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 791/1554] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.191358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.194350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549e3fe-3dbf-41b1-a282-7ad655a6f2c2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.200181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.200827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c692f-02b8-47ea-af5f-f734118b2047 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.201079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.201243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.201515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.202230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.202529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.204163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4537f2-a71f-4d67-8eb3-8667a5d6562f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.205387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.205991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.206270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.206543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.207257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.207687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.208716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:15:40.208716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:15:40.208716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:15:40.209731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.216265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 764/1555] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.217655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdada00-4648-4347-a423-537b58d772c6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.218069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdada00-4648-4347-a423-537b58d772c6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.218348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdada00-4648-4347-a423-537b58d772c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.225155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 792/1556] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.225985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.237096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44345f83-8789-4032-8271-84126dd3e826 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.239105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dcdada00-4648-4347-a423-537b58d772c6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.240324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dcdada00-4648-4347-a423-537b58d772c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.241709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.242310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.242592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.242865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.243572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.243869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.245447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1b85-6303-452d-aaef-8193f76da106 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.249078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 765/1557] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.250249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d3a4-73e6-478a-b71c-91ba5bb8529f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.250535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d3a4-73e6-478a-b71c-91ba5bb8529f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.250804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d3a4-73e6-478a-b71c-91ba5bb8529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.269685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 793/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.269685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.269685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.269685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.276796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cb92d3a4-73e6-478a-b71c-91ba5bb8529f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.277670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cb92d3a4-73e6-478a-b71c-91ba5bb8529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.285724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 766/1559] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.286983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c0e35-f88a-435b-959f-0a78adabf525 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.287303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c0e35-f88a-435b-959f-0a78adabf525 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.287581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c0e35-f88a-435b-959f-0a78adabf525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.291037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] MFA Rules not processed for user `43145493670d4969a0739063f90fdd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.292444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.296114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:40.309592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1a6c0e35-f88a-435b-959f-0a78adabf525 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.311433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a6c0e35-f88a-435b-959f-0a78adabf525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.320171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 767/1560] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.321431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.321717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.321990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.340738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:40.344136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.345327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.353610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 768/1561] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.354357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.363327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 794/1562] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.364194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.364299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f0fa7-36e1-4a24-98ef-a3d67d9c2f0b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.369080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.369673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.369953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.370222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.370887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.371936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:15:40.371936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:15:40.371936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:15:40.374101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d78e8-83ca-4d4a-ba87-8ad578b2a445 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.375911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8f011-3df0-4d6d-a416-ee6288cf872f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.380578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.381185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.381465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.381738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.382445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.384380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.402253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 769/1563] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.403281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c733-c96b-4064-8cd1-dfc60b7e7c5b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.403593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c733-c96b-4064-8cd1-dfc60b7e7c5b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.404584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c733-c96b-4064-8cd1-dfc60b7e7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.421468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 795/1564] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.421468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.427333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9cc3c733-c96b-4064-8cd1-dfc60b7e7c5b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.428531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9cc3c733-c96b-4064-8cd1-dfc60b7e7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.486734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d17147-114a-427b-96a9-ebe043be60f8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.489711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 770/1565] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.491085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04daaf9-7b15-4c53-b465-09b945e0e1a8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.491400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04daaf9-7b15-4c53-b465-09b945e0e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.491672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04daaf9-7b15-4c53-b465-09b945e0e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.495119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.495772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.496054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.496328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.496987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.499491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.511677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c04daaf9-7b15-4c53-b465-09b945e0e1a8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.512885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c04daaf9-7b15-4c53-b465-09b945e0e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.522161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 771/1566] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.523387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.523665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.523932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.530416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 796/1567] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.530416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.547319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.548522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.589587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4636c-7e45-48f0-a81a-4dcb5a3cb7a9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.594839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.595482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.595771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.596047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.597359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.597676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.599326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8d8e0-4352-4e07-ad43-4416e957ba14 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.608714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 772/1568] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.609531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.618546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 797/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.618546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b79ef-afa3-4146-860f-ebdda1f90da0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.618546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b79ef-afa3-4146-860f-ebdda1f90da0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.618546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b79ef-afa3-4146-860f-ebdda1f90da0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.618546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 798/1570] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 05:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:15:40.618546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b79ef-afa3-4146-860f-ebdda1f90da0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.619642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1c39-5093-4170-aac2-1b57e2f88b3c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.624671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.625278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.625555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.625825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.626474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.628420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.630300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b79ef-afa3-4146-860f-ebdda1f90da0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.634764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.635381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.635717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.636111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.636736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.637757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:15:40.637757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:15:40.637757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:15:40.639503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.650992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 773/1571] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.651828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.663783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdb2a4-dab9-4781-9e5d-2cce6423376f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.667988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 799/1572] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.668330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.668820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.668951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.669194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.670121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.670808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.671105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.672737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.680944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317a82-b7db-4c2f-927c-2f7cc55d7a9b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.685486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.685968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 774/1573] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.686092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.686341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.686609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.686754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.687311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.687610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.689185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.701676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 800/1574] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.702559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.703318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f884-1792-4cf5-8216-691bc76744bf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.707844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.708442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.708722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.708993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.709635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.711562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.718464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe76669-6767-45fc-a5e5-077e10cd53d9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.723536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.724222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.724548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.724856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.725620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:40.725982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.727693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdded2-346e-4ea8-bdf4-32da76306af8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.733765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 775/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.734752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.740889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 801/1576] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:40.741907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.742184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.742467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.746181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3957-6926-46c0-bfd1-d0f99d21c74e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.749027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:40.751680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.752327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.752556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.752823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.753472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.755382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.768383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:40.783914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:40.785121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:40.786413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 776/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.787366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.848456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d7eba-54d3-4386-be97-6ff507433e24 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.852996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.853469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 802/1578] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:40.853587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.853941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.854220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.854325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.854907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.856575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.873554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 777/1579] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:40.873756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec6a23-3a3d-49a9-bd54-121d1230061f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.873857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.877855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.878467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.878746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.879013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.879744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.881332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.883267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57db7f-5525-4593-b13f-b3b6f5db6504 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.887802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.888424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.888707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.888974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.889620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.891542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.891681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 803/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:40.892300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.901921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534ebb-9240-4463-b665-be87e41b3d25 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:40.906676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:40.907295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:40.907573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:40.907839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:40.908536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:40.910503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:40.922857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 778/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.922857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.939534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 804/1582] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:40.940393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:40.987539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c962ae-ea4c-4e17-9fb7-a33a54bef1b0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.004034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a1a76-9b60-461a-9c9b-26b79d25f502 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.008871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.009477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.009755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.010032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.010713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.012657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.041420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 805/1583] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:40 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:41.042218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.044420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.045570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.045852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.046123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.046836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.048609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.061730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 779/1584] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.061730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.069624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:41.084197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:41.114643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7d87-3b4e-409d-b8cd-57b77ab25186 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.119117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.119750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.120033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.120299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.120950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.123020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.134452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badaa12-9403-43a6-8f81-9ce8ed50289d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.143820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 806/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:41.144691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.154952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f272-cae0-445d-91a9-905eeb1fa532 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.159905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.160633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.161063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.161186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.162154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.163816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.177248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 807/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.178274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.188358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18941757-19c4-4bf5-888e-253127fe2620 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.193169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.193779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.194064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.194364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.195340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.196935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.207679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 808/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.208482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.209845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.211239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.211560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.211868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.221413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce8013-3c75-4a57-b87b-1fd306a39fa6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.225986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.226583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.226864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.227141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.227809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.229726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.252960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 809/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:41.253735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.263420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8374-6b34-4d25-bcc0-e50375f782b8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.267903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.268483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.268761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.269023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.269663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.271591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.275578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.277250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.287946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 780/1589] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:41.292040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.296558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 810/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:41.296558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.303717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407c540-ef99-4c39-b083-bab0bb111c8e service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.305975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672a9f-e296-480f-b754-07e036d6c0c4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.308356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.308956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.309248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.309556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.310521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.310767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.311384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.311669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.311931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.312448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.312644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.314157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.325439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 811/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.328081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.338235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 781/1592] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/users => generated 282 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:41.338520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd1ba7-cc28-4fa4-abc5-c3b4f6b70a99 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.342674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.343583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.344175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.344453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.344723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.345518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.347111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.353990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab13e5-d034-498b-815e-4c9288f87fc2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.358855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 812/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.359640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.362581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.363576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.363859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.364204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] PATH_INFO: `/v3/projects/f894fc36cb1043c2aa2ee02e8ea6ae79/users/9472a36e5f8940d6a780624274324948/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.370436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e4156-189b-4483-816b-3982bbe10c23 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.375131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.375805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.376082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.376341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] PATH_INFO: `/v3/projects/96ea99a4a8ba4249a26a0c5aed967655/users/386a456c559546bcbecc0181ce656a30/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.381030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f894fc36cb1043c2aa2ee02e8ea6ae79, user_id=9472a36e5f8940d6a780624274324948, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.383737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.391815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ea99a4a8ba4249a26a0c5aed967655, user_id=386a456c559546bcbecc0181ce656a30, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.394431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.398141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 782/1594] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:41 2022] PUT /identity/v3/projects/f894fc36cb1043c2aa2ee02e8ea6ae79/users/9472a36e5f8940d6a780624274324948/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:41.399364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.410022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:41.416726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 813/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:41 2022] PUT /identity/v3/projects/96ea99a4a8ba4249a26a0c5aed967655/users/386a456c559546bcbecc0181ce656a30/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:41.417431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.477781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05998bd-5d74-415d-bfd5-f727e3cc0e51 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.480434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52ccfa-b45f-4588-9cdd-e49d11bedd41 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.482793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.483436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.483721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.483993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.484671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.485821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.486251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.486492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.486771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.487360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.487762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.489327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.496768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 783/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.497761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.502165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 814/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.502165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.508039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154aca6-73b5-484a-aa20-5f701beb21cc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.509884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b6dd-3d40-4bf3-9af9-40f1233f1d6a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.514392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bff1e-b4c2-4a57-9122-afcda2f7714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.514864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bff1e-b4c2-4a57-9122-afcda2f7714a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.515241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bff1e-b4c2-4a57-9122-afcda2f7714a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.515375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.517939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bff1e-b4c2-4a57-9122-afcda2f7714a admin admin] PATH_INFO: `/v3/projects/8880ad6f9e8b4ed3b977816b4d1d2789/users/15cdae89b11242959beea938c801cd54/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.520144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.520144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.520144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.520144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.520144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.531946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 815/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.532431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.539835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:41.542248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bff1e-b4c2-4a57-9122-afcda2f7714a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8880ad6f9e8b4ed3b977816b4d1d2789, user_id=15cdae89b11242959beea938c801cd54, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.543422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c5e19-4a5e-49fb-82f1-4c1724acc82c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.546908 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bff1e-b4c2-4a57-9122-afcda2f7714a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.549947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61830fd-08ef-4d81-9812-90ea17f35682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.551095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61830fd-08ef-4d81-9812-90ea17f35682 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.551571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61830fd-08ef-4d81-9812-90ea17f35682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.551956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61830fd-08ef-4d81-9812-90ea17f35682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.552713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61830fd-08ef-4d81-9812-90ea17f35682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.554669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61830fd-08ef-4d81-9812-90ea17f35682 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.563485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 784/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:41 2022] PUT /identity/v3/projects/8880ad6f9e8b4ed3b977816b4d1d2789/users/15cdae89b11242959beea938c801cd54/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:41.564833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.565334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.565676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.578307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 816/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.579490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.579774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.580131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.595467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] MFA Rules not processed for user `9472a36e5f8940d6a780624274324948`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:41.596877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:41.598017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:41.599849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:41.659317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 817/1601] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:41.661202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.669072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 785/1602] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:41.670812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.675309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7d4d-b156-42ed-bfe1-426993b78aac None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.680521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29626beb-efe4-436c-aed9-d960a7dbc5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.681348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39178d-95bf-4e8e-be0c-f65ae228cc03 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.681697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29626beb-efe4-436c-aed9-d960a7dbc5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.682383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29626beb-efe4-436c-aed9-d960a7dbc5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.682861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29626beb-efe4-436c-aed9-d960a7dbc5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.684083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29626beb-efe4-436c-aed9-d960a7dbc5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.686742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.687411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.687744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29626beb-efe4-436c-aed9-d960a7dbc5bb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.687856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.688123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.688739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.690315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.702016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 786/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.702945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.705511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 818/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.707314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.707817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.708614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.713479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8370-0d46-490f-8d98-f21669b69a3a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.718842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.719467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.719742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.720015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.720687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.722262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.733120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 787/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:41.733893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.743485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd338-4106-4180-97e2-cfb915d95006 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.746847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] MFA Rules not processed for user `15cdae89b11242959beea938c801cd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:41.749033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:41.749170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.749770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.750051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.750353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] PATH_INFO: `/v3/projects/1d45f00d406e4b5b881175b8768a955d/users/9dfdfa59d49148cb9d441fc95d26ec5b/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.770923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d45f00d406e4b5b881175b8768a955d, user_id=9dfdfa59d49148cb9d441fc95d26ec5b, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.773647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.796020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 788/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:41 2022] PUT /identity/v3/projects/1d45f00d406e4b5b881175b8768a955d/users/9dfdfa59d49148cb9d441fc95d26ec5b/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:41.796699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.829011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:41.843299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 819/1607] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:41.844267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.858706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a692f0-b9c7-4285-8ee4-45df8319b140 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.878588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d7295-c904-4321-8d40-2c7e7dc0625d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:41.882185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.882789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.883065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.883364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.915587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:41.916201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:41.916477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:41.916743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:41.917387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.919500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.939931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:41.944115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:41.945871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:41.952227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 820/1608] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:41 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:41.952227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.957236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 789/1609] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:41.957909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:41.967194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c890a-abf8-428b-826a-74ec62fec491 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.019509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce21485-9121-411d-89d2-b01dd99a9502 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.024670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.025342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.025620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.025894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] PATH_INFO: `/v3/projects/7a9f33da4e484b7d822f30f5b889a08d/users/f7f6100716724f508cedd401d3203aa9/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.039673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a68f-3465-4883-837e-34c6489421fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.040838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a68f-3465-4883-837e-34c6489421fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.041302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a68f-3465-4883-837e-34c6489421fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.041892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a68f-3465-4883-837e-34c6489421fc admin admin] PATH_INFO: `/v3/projects/18b368a852434624a3a44cd80628aef6/users/20bd2f5da95a4d029adbe7b1e0f75bc3/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.046077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9f33da4e484b7d822f30f5b889a08d, user_id=f7f6100716724f508cedd401d3203aa9, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.049369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.063692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a68f-3465-4883-837e-34c6489421fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b368a852434624a3a44cd80628aef6, user_id=20bd2f5da95a4d029adbe7b1e0f75bc3, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.064026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 821/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:41 2022] PUT /identity/v3/projects/7a9f33da4e484b7d822f30f5b889a08d/users/f7f6100716724f508cedd401d3203aa9/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:42.064823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.067001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a68f-3465-4883-837e-34c6489421fc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.083463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 790/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:41 2022] PUT /identity/v3/projects/18b368a852434624a3a44cd80628aef6/users/20bd2f5da95a4d029adbe7b1e0f75bc3/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:42.084904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d52718-e822-4614-bcd3-8fb34f8e0d1d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.085256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d52718-e822-4614-bcd3-8fb34f8e0d1d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.085595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d52718-e822-4614-bcd3-8fb34f8e0d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.115131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-54d52718-e822-4614-bcd3-8fb34f8e0d1d None None] MFA Rules not processed for user `9dfdfa59d49148cb9d441fc95d26ec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.116598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-54d52718-e822-4614-bcd3-8fb34f8e0d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.149172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7b5d-901d-4477-a1dd-51baa19bb3bb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.171052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:42.206236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 791/1612] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:42.207839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68abe75-bd94-4cf3-a111-c4a9b0209f4b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.208209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68abe75-bd94-4cf3-a111-c4a9b0209f4b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.208572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68abe75-bd94-4cf3-a111-c4a9b0209f4b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.209967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 792/1613] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 05:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:15:42.211719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68abe75-bd94-4cf3-a111-c4a9b0209f4b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.237164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.237942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.238372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.238492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] PATH_INFO: `/v3/projects/af8a10afff4b492c9277af86ef1b5770/users/df32f6fe92df4a24aa90d35573d579aa/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.257407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8a10afff4b492c9277af86ef1b5770, user_id=df32f6fe92df4a24aa90d35573d579aa, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.260875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.282756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 822/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:42 2022] PUT /identity/v3/projects/af8a10afff4b492c9277af86ef1b5770/users/df32f6fe92df4a24aa90d35573d579aa/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:42.282756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.295749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:42.305898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68abe75-bd94-4cf3-a111-c4a9b0209f4b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.386942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fbdc-7ff5-4fba-880b-fd48f8fc6575 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.391867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbafc86-b16d-4cc2-8474-8736e0fb11c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.392565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafc86-b16d-4cc2-8474-8736e0fb11c3 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.393436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafc86-b16d-4cc2-8474-8736e0fb11c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.393436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafc86-b16d-4cc2-8474-8736e0fb11c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.393629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b44e9d-66d4-458e-b1a3-aee2b85cf1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.394164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b44e9d-66d4-458e-b1a3-aee2b85cf1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.394492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b44e9d-66d4-458e-b1a3-aee2b85cf1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.394773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b44e9d-66d4-458e-b1a3-aee2b85cf1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.395567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b44e9d-66d4-458e-b1a3-aee2b85cf1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.397859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b44e9d-66d4-458e-b1a3-aee2b85cf1a2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.434260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 823/1615] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:42.435894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008d616-05bc-474d-a5b3-59a235862fbf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.436172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008d616-05bc-474d-a5b3-59a235862fbf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.436470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008d616-05bc-474d-a5b3-59a235862fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.459437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5008d616-05bc-474d-a5b3-59a235862fbf None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.460698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5008d616-05bc-474d-a5b3-59a235862fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.467754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbafc86-b16d-4cc2-8474-8736e0fb11c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.469861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 824/1616] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:42.470486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbafc86-b16d-4cc2-8474-8736e0fb11c3 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.474111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96b06-c0e0-4587-a156-1aa0192072de None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.474393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96b06-c0e0-4587-a156-1aa0192072de None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.474666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96b06-c0e0-4587-a156-1aa0192072de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.487357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 793/1617] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:42.489450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e199-83d9-405a-adca-4785026094f9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.490022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e199-83d9-405a-adca-4785026094f9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.490451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e199-83d9-405a-adca-4785026094f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.494705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d7f96b06-c0e0-4587-a156-1aa0192072de None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.495918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d7f96b06-c0e0-4587-a156-1aa0192072de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.516829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5715e199-83d9-405a-adca-4785026094f9 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.518049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5715e199-83d9-405a-adca-4785026094f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.523798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 825/1618] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:42.525555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.525997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.526352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.533530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 794/1619] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:42.534307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e199-83d9-405a-adca-4785026094f9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.546561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e199-83d9-405a-adca-4785026094f9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.551929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.552550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.552835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.553110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.553841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.555459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.557581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] MFA Rules not processed for user `df32f6fe92df4a24aa90d35573d579aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.558382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:42.558804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.571745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 795/1620] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:42.571745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.633518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b46864-0b7d-4c38-bdd4-d2c7a9aeb1ab admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.637326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241788b-1fa3-49a7-a472-ca56166d2a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.638054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241788b-1fa3-49a7-a472-ca56166d2a0a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.638970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241788b-1fa3-49a7-a472-ca56166d2a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.639316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241788b-1fa3-49a7-a472-ca56166d2a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.646237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 826/1621] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:42.650173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241788b-1fa3-49a7-a472-ca56166d2a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.651401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241788b-1fa3-49a7-a472-ca56166d2a0a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.651695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.663692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 796/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:42.665141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65f80-4c5d-4a8e-8783-ae86efff46e5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.665428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65f80-4c5d-4a8e-8783-ae86efff46e5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.665571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4528c4-6ac4-4b90-9986-5f47344a4e9c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.665702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65f80-4c5d-4a8e-8783-ae86efff46e5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.667125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 797/1623] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 05:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:15:42.670384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.671211 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.671805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.672098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.673370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a27a-cd3c-4e18-85af-03d639f5a85a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.673654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a27a-cd3c-4e18-85af-03d639f5a85a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.674043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a27a-cd3c-4e18-85af-03d639f5a85a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.679690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 798/1624] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 05:15:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:15:42.680625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a27a-cd3c-4e18-85af-03d639f5a85a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.690420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.691927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.698088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a27a-cd3c-4e18-85af-03d639f5a85a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.707778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfcd8-371e-4582-8856-861a12043eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.710110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfcd8-371e-4582-8856-861a12043eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.710394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfcd8-371e-4582-8856-861a12043eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.711108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfcd8-371e-4582-8856-861a12043eab admin admin] PATH_INFO: `/v3/projects/e36c4ca225cf4a1ea68bc023874f2e6e/users/06c8ab149f6a45c98ca6e53fe89baca3/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.717855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 827/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:42.720473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.732532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257897-e5d2-44e0-b7ed-4e261ed7f377 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:42.737406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5be6-2bfc-43bb-bf55-a603a04c1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:42.738162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5be6-2bfc-43bb-bf55-a603a04c1ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.738351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfcd8-371e-4582-8856-861a12043eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36c4ca225cf4a1ea68bc023874f2e6e, user_id=06c8ab149f6a45c98ca6e53fe89baca3, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.738484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5be6-2bfc-43bb-bf55-a603a04c1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.738792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5be6-2bfc-43bb-bf55-a603a04c1ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.739491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5be6-2bfc-43bb-bf55-a603a04c1ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:42.741526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5be6-2bfc-43bb-bf55-a603a04c1ac4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.742252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfcd8-371e-4582-8856-861a12043eab admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:42.765172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 799/1626] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:42 2022] PUT /identity/v3/projects/e36c4ca225cf4a1ea68bc023874f2e6e/users/06c8ab149f6a45c98ca6e53fe89baca3/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:42.766859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.767300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.767626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.796824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.798491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.803464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 828/1627] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/projects => generated 361 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:42.813524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:42.813814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:42.814088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:42.860192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:42.861210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:42.900460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 800/1628] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:42.901419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:42.955937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:43.007314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745134-570e-485b-be91-5688d8d2d065 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.013411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.014516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.014828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.015501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.016587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.018450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.028760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 829/1629] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:43.038327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 801/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:43.039406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.043597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.046888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:43.065952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c9c5-781d-4048-b977-aef609e22a0c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.071856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.072690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.073148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.073878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.077327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.083375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.136001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 830/1631] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:43 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:43.136001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.154951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61fb5b-2d27-4067-abdf-85ab6796ca20 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.174108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.174712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.174997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.175299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] PATH_INFO: `/v3/projects/e36c4ca225cf4a1ea68bc023874f2e6e/users/06c8ab149f6a45c98ca6e53fe89baca3/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.175846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b9f1a-9998-42d3-a9fb-12bfe004903e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.179410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36c4ca225cf4a1ea68bc023874f2e6e, user_id=06c8ab149f6a45c98ca6e53fe89baca3, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.183700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.184385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.184666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.185082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.186602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.206049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.207535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.212512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 831/1632] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:43 2022] PUT /identity/v3/projects/e36c4ca225cf4a1ea68bc023874f2e6e/users/06c8ab149f6a45c98ca6e53fe89baca3/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:43.222481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.240237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 802/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:43.241103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.264735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78876f72-5e9b-4f4a-841e-f85f739ca0c4 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.345237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598dfc2-e875-48da-946d-9c51f8846e43 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.355145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.357999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.357999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.357999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.396843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c23e23-2bb7-4f83-8386-ba93023a5a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.397484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23e23-2bb7-4f83-8386-ba93023a5a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.398489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23e23-2bb7-4f83-8386-ba93023a5a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.400239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23e23-2bb7-4f83-8386-ba93023a5a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.402652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c23e23-2bb7-4f83-8386-ba93023a5a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.407757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c23e23-2bb7-4f83-8386-ba93023a5a6f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.442376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 803/1634] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:43.447378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.447670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.447950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.526989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.529378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.536612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] MFA Rules not processed for user `06c8ab149f6a45c98ca6e53fe89baca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:43.537924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:43.562661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 832/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:43.563778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.587078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ab48-5b1a-4592-961d-f21630884362 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.599794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.600587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.600985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.601341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] PATH_INFO: `/v3/projects/107049e3d7884960834eb9ebf8419c88/users/217a49af9f434eef80e51cdab73ace66/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.636135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107049e3d7884960834eb9ebf8419c88, user_id=217a49af9f434eef80e51cdab73ace66, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.642155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.676121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 833/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:43 2022] PUT /identity/v3/projects/107049e3d7884960834eb9ebf8419c88/users/217a49af9f434eef80e51cdab73ace66/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:43.677339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.742496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:43.750442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 804/1637] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:43.751469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.770335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c83de6-d64e-4c17-9c5d-8d9b4d0442e7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.826136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca420a-7a81-4019-a269-15cc6b5ca033 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.829972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:43.836326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.837225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.841193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.841947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.843196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:43.844902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:43.866355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 834/1638] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:43.866355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:43.929501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.930027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.930319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.930593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:43.954612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0eb05-e5ec-4738-af43-d96c148dfbe1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:43.959752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039813d5-9c5e-4fd6-b731-16ddfdbf09fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:43.960860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039813d5-9c5e-4fd6-b731-16ddfdbf09fe service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:43.960860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039813d5-9c5e-4fd6-b731-16ddfdbf09fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:43.963029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039813d5-9c5e-4fd6-b731-16ddfdbf09fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:44.067814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:44.070290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:44.095439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039813d5-9c5e-4fd6-b731-16ddfdbf09fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:44.096266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 805/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:44.097026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039813d5-9c5e-4fd6-b731-16ddfdbf09fe service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:44.108425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:44.131480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 835/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:44.136778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74941a-425c-4a9e-8a29-10f75f4e85a2 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:44.143584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:44.144342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:44.144741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:44.145115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] PATH_INFO: `/v3/projects/107049e3d7884960834eb9ebf8419c88/users/217a49af9f434eef80e51cdab73ace66/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:44.147433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=107049e3d7884960834eb9ebf8419c88, user_id=217a49af9f434eef80e51cdab73ace66, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:44.151549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:44.236369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 806/1641] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:44 2022] PUT /identity/v3/projects/107049e3d7884960834eb9ebf8419c88/users/217a49af9f434eef80e51cdab73ace66/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:44.244440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:44.244440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:44.244440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:44.262367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] MFA Rules not processed for user `217a49af9f434eef80e51cdab73ace66`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:44.269291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:44.416824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:44.467775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 836/1642] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:44.522375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:44.662607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebc61a-5490-4621-bb5c-5632387fddfd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:44.667442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:44.669028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:44.669028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:44.669028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:44.682926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:44.684516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:44.696864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 807/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:44.937757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:45.135321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:45.152088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbc49-16f0-4ac4-8771-3e0b882439aa service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:45.153853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c9c9-65f2-40ac-a49f-91889d15d0ac None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:45.166824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:45.169230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:45.169919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:45.170513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] PATH_INFO: `/v3/users/43145493670d4969a0739063f90fdd8a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:45.173128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43145493670d4969a0739063f90fdd8a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:45.178515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:45.181252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:45.181907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:45.185656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:45.186237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:45.297564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43145493670d4969a0739063f90fdd8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:45.299820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43145493670d4969a0739063f90fdd8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:45.303922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43145493670d4969a0739063f90fdd8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:45.334126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43145493670d4969a0739063f90fdd8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:45.352451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c4581e54-afb2-43fb-9d46-151833ccd932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43145493670d4969a0739063f90fdd8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:45.376151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:45.394579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:45.396309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:45.406770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 837/1644] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:44 2022] DELETE /identity/v3/users/43145493670d4969a0739063f90fdd8a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:45.412449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:45.412750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:45.413033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:45.436288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 808/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:15:45.469547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:45.476882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:45.672963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 838/1646] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:45.804909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:45.934315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8dc3d-3a14-4214-9783-c6304484ab02 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:46.050584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7995591-4224-4831-b157-9440622fbe78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:46.051252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7995591-4224-4831-b157-9440622fbe78 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:46.051539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7995591-4224-4831-b157-9440622fbe78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:46.051817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7995591-4224-4831-b157-9440622fbe78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:46.075096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7995591-4224-4831-b157-9440622fbe78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:46.077582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7995591-4224-4831-b157-9440622fbe78 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:46.132601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 809/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:48.170628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:48.172772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:48.209778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101b148-5373-4170-ac80-f5696343e3f8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:48.233489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:48.236408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:48.237187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:48.239513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] PATH_INFO: `/v3/users/9dfdfa59d49148cb9d441fc95d26ec5b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:48.242566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfdfa59d49148cb9d441fc95d26ec5b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:48.247124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:48.265779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:48.454352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfdfa59d49148cb9d441fc95d26ec5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:48.462853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfdfa59d49148cb9d441fc95d26ec5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:48.466637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfdfa59d49148cb9d441fc95d26ec5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:48.532116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfdfa59d49148cb9d441fc95d26ec5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:48.563492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfdfa59d49148cb9d441fc95d26ec5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:48.641740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 839/1648] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:48 2022] DELETE /identity/v3/users/9dfdfa59d49148cb9d441fc95d26ec5b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:48.646068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:48.646574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:48.646650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:48.656317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:48.665055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:48.721409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:48.729427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:48.863344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19fda9-d56f-443e-996a-1f951a385491 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:48.873817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:48.874545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:48.874829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:48.875103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] PATH_INFO: `/v3/projects/c49ab6059ec643e5b702cd79662d2531` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:48.877602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49ab6059ec643e5b702cd79662d2531)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:48.878748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:15:48.878748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 05 05:15:48.878748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: Aug 05 05:15:48.880895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:48.941501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 810/1649] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:48.979774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:48.985795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.034539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a908029-61ce-4c10-9597-172851c4ce84 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:49.084246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49ab6059ec643e5b702cd79662d2531', 'request_id': 'req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.108494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49ab6059ec643e5b702cd79662d2531', 'request_id': 'req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.130922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49ab6059ec643e5b702cd79662d2531', 'request_id': 'req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.141490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:49.163266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:49.164047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.164332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.164608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] PATH_INFO: `/v3/users/9472a36e5f8940d6a780624274324948` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.166078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9472a36e5f8940d6a780624274324948)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:49.167244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:15:49.167244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 05 05:15:49.167244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: Aug 05 05:15:49.168477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:49.180976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] The token cache is being invalidate because project c49ab6059ec643e5b702cd79662d2531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:49.181407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.183785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.187228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 840/1650] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:48 2022] DELETE /identity/v3/projects/c49ab6059ec643e5b702cd79662d2531 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:49.188453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:49.191001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.229426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:49.296251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9472a36e5f8940d6a780624274324948'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.297683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9472a36e5f8940d6a780624274324948'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.298578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9472a36e5f8940d6a780624274324948'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.318646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9472a36e5f8940d6a780624274324948'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.327428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f056-7f4d-45ea-8c6a-a2ac876bef9d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:49.336976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:49.337621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.337917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.338184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.345173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.347728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d856bfc0-bb80-432b-8bb7-6ba7db6a2711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9472a36e5f8940d6a780624274324948'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:49.375967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:49.379979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da945319-56ba-4eca-a9f1-ae0972071b32 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:49.401821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 841/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:49.410125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 811/1652] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:48 2022] DELETE /identity/v3/users/9472a36e5f8940d6a780624274324948 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:49.410303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680f82-2807-412d-ad89-2b6f6a0b6b5e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.410640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680f82-2807-412d-ad89-2b6f6a0b6b5e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.410985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680f82-2807-412d-ad89-2b6f6a0b6b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.416393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.416684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.417480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.474295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:49.478096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-81680f82-2807-412d-ad89-2b6f6a0b6b5e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:49.479360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-81680f82-2807-412d-ad89-2b6f6a0b6b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.481010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.609046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 842/1653] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:49.618428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 812/1654] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:15:49.625925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.625925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.625925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.641455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:49.643319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.667011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:49.669614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:49.701370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 843/1655] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:49.702404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:49.722863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8cf2-db46-4fe0-8bb9-dd0a81575445 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:49.745027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:49.745027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.745027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.745397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.746122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:49.746427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:49.748485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:49.790588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 844/1656] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:49.792790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:49.793845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61c8f-ed43-4e0b-9dc4-f3ac52fea4f4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:49.814956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:49.814956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.814956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.814956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.815418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f7734-93d9-44e6-a280-527993d86bf8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:49.834078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:49.834711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:49.834986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:49.835302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:49.837789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:49.837903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:49.857397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:49.858313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:49.881850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 813/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:15:49.925442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 845/1658] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:49 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:49.929315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:49.974522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8d365-5324-4149-b402-55a3298469e5 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:50.034092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:50.119093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:50.120889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:50.179778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:50.180421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.180704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.180979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.182010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:50.184020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:50.232539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 814/1659] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:49 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:50.237923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:50.265043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e91f92-b46d-4971-ba76-9b4290546d37 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:50.276920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:50.277571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.278035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.278843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.280823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:50.284365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:50.301798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c893dc-26ac-43ca-bfa6-b65c0e4d0910 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:50.319216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:50.320119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.320394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.320658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] PATH_INFO: `/v3/users/15cdae89b11242959beea938c801cd54` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.322015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cdae89b11242959beea938c801cd54)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:50.324176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:50.327842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 815/1660] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:50.332138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:50.361520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35179cea-3259-41ac-a48d-8fd4d6bcbe78 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:50.374010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:50.374795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.375086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.375391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.376231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:50.377857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:50.380490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:50.410376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 816/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:50.418158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:50.442038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c613eec-f75f-4217-accb-1a05a108cc1e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:50.457122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cdae89b11242959beea938c801cd54'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:50.457122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cdae89b11242959beea938c801cd54'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:50.458086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cdae89b11242959beea938c801cd54'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:50.459183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94557a-7399-4add-8c50-7fbcb8e49caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:50.459880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94557a-7399-4add-8c50-7fbcb8e49caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.460205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94557a-7399-4add-8c50-7fbcb8e49caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.460709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94557a-7399-4add-8c50-7fbcb8e49caa admin admin] PATH_INFO: `/v3/projects/829faccb620448cb9176560936525ae0/users/43d6fde08d4f48aaa82264dbda4dae57/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.489991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cdae89b11242959beea938c801cd54'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:50.500846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94557a-7399-4add-8c50-7fbcb8e49caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=829faccb620448cb9176560936525ae0, user_id=43d6fde08d4f48aaa82264dbda4dae57, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:50.503624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94557a-7399-4add-8c50-7fbcb8e49caa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:50.515413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-076a85f5-4494-4506-b9e1-59e4e944e614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cdae89b11242959beea938c801cd54'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:50.536600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 846/1662] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:50 2022] DELETE /identity/v3/users/15cdae89b11242959beea938c801cd54 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:15:50.541150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.541750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.542187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.568534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 817/1663] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:50 2022] PUT /identity/v3/projects/829faccb620448cb9176560936525ae0/users/43d6fde08d4f48aaa82264dbda4dae57/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:50.570308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21f1e-aa4e-42e0-b395-09c756f1d956 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.570603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21f1e-aa4e-42e0-b395-09c756f1d956 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.570882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21f1e-aa4e-42e0-b395-09c756f1d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.587407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:50.590453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:50.724199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fcf21f1e-aa4e-42e0-b395-09c756f1d956 None None] MFA Rules not processed for user `43d6fde08d4f48aaa82264dbda4dae57`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:50.727000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fcf21f1e-aa4e-42e0-b395-09c756f1d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:50.745854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 847/1664] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:50.772011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:50.774448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:50.882514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 818/1665] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:50.887742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.888221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.888574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.930203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb8fdb-ac7a-4771-b6d1-b2e1072594d4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:50.936605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:50.937693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:50.938993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:50.938993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:50.952560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:50.953244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] MFA Rules not processed for user `386a456c559546bcbecc0181ce656a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:50.954506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:50.958177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:50.972922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 848/1666] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:50.974107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:50.975730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:50.993217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8bb5f-e997-46ca-9fb6-4272b35db4ae service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.000100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.000938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.001471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.002045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.002949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.006564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.040692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:51.078495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 849/1667] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:50 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:51.083085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.142766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 819/1668] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:51.145432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:51.152572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.158077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:51.289239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3864d-0ee1-4b6c-ac61-9548397faf0b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.312669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.314385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.316245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.318483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.324865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.337643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.368141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8e91-8c15-4a19-842c-0ebb92996817 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.412020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 850/1669] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:51 2022] POST /identity/v3/users => generated 294 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:51.416218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.438374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686332b-7add-48f9-a884-69d134587f2d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.465786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.466425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.466669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.467032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.477686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.480440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.497746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 851/1670] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:51.505055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.521119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.522002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.522425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.522866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.545096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bb336-2e3d-4edb-8917-cfae6c85069b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.557024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.557729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.558020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.558296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] PATH_INFO: `/v3/projects/4f8f1267349848809432c21275879d5e/users/e26c7405231a45809817ca3b008a4df9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.594365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8f1267349848809432c21275879d5e, user_id=e26c7405231a45809817ca3b008a4df9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.597282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.638533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 852/1671] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:51 2022] PUT /identity/v3/projects/4f8f1267349848809432c21275879d5e/users/e26c7405231a45809817ca3b008a4df9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:51.640120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.648399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:51.759929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.765550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.803587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 820/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:15:51.804568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.840522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d75c9-ea81-4e75-8b1d-10e1cfa54014 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.846302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.846939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.847293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.847539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.848239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.850427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.861415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d282bb8-0b27-4e39-a888-f002a580cfed admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.877439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 821/1673] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:51.881457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:51.900917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:51.915355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec5ff-4671-4936-af84-a78f265314ef admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:51.915801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.916486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.916770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.917083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] PATH_INFO: `/v3/projects/8880ad6f9e8b4ed3b977816b4d1d2789` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.921065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8880ad6f9e8b4ed3b977816b4d1d2789)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.925524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.936400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfa768-6482-41b4-9b1e-88630779c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:51.937104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfa768-6482-41b4-9b1e-88630779c6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.937390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfa768-6482-41b4-9b1e-88630779c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.937671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfa768-6482-41b4-9b1e-88630779c6a8 admin admin] PATH_INFO: `/v3/projects/4f8f1267349848809432c21275879d5e/users/e26c7405231a45809817ca3b008a4df9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:51.946047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfa768-6482-41b4-9b1e-88630779c6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8f1267349848809432c21275879d5e, user_id=e26c7405231a45809817ca3b008a4df9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:51.949040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfa768-6482-41b4-9b1e-88630779c6a8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:51.977029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 822/1674] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:51 2022] PUT /identity/v3/projects/4f8f1267349848809432c21275879d5e/users/e26c7405231a45809817ca3b008a4df9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:51.993693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:51.996520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:51.996887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:52.041119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8880ad6f9e8b4ed3b977816b4d1d2789', 'request_id': 'req-19a4f995-7e0a-4a3b-be96-4aca40015aa3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.070468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8880ad6f9e8b4ed3b977816b4d1d2789', 'request_id': 'req-19a4f995-7e0a-4a3b-be96-4aca40015aa3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.087202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] MFA Rules not processed for user `e26c7405231a45809817ca3b008a4df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:52.088572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.092185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8880ad6f9e8b4ed3b977816b4d1d2789', 'request_id': 'req-19a4f995-7e0a-4a3b-be96-4aca40015aa3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.113947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:52.118036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] The token cache is being invalidate because project 8880ad6f9e8b4ed3b977816b4d1d2789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:52.118328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.120379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-19a4f995-7e0a-4a3b-be96-4aca40015aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.123187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 853/1675] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:51 2022] DELETE /identity/v3/projects/8880ad6f9e8b4ed3b977816b4d1d2789 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:52.129403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:52.131933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:52.132368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:52.233326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:52.234566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.349396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 823/1676] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:52.350428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:52.354279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.428783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 854/1677] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:15:52.431088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:52.439963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.468829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89982c-7a67-409f-9514-0d0966fa77c6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:52.478920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:52.480332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:52.480773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:52.481052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] PATH_INFO: `/v3/projects/1d45f00d406e4b5b881175b8768a955d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:52.482939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d45f00d406e4b5b881175b8768a955d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:52.485530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:52.544129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b694-7352-42b3-9650-4aaef47cfbc8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:52.555773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:52.556505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:52.558124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:52.558799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] PATH_INFO: `/v3/projects/f894fc36cb1043c2aa2ee02e8ea6ae79` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:52.560733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f894fc36cb1043c2aa2ee02e8ea6ae79)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:52.564795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:52.606168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d45f00d406e4b5b881175b8768a955d', 'request_id': 'req-f70adf48-e434-4a0c-b8c7-cefb164d7478'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.629008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d45f00d406e4b5b881175b8768a955d', 'request_id': 'req-f70adf48-e434-4a0c-b8c7-cefb164d7478'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.644365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d45f00d406e4b5b881175b8768a955d', 'request_id': 'req-f70adf48-e434-4a0c-b8c7-cefb164d7478'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.680431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] The token cache is being invalidate because project 1d45f00d406e4b5b881175b8768a955d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:52.681159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.682084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.685012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 855/1678] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:52 2022] DELETE /identity/v3/projects/1d45f00d406e4b5b881175b8768a955d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:52.686192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:52.689633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.694306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f894fc36cb1043c2aa2ee02e8ea6ae79', 'request_id': 'req-987af117-f62c-4619-8e0b-5bd4d64b7307'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.711811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f894fc36cb1043c2aa2ee02e8ea6ae79', 'request_id': 'req-987af117-f62c-4619-8e0b-5bd4d64b7307'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.738694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f894fc36cb1043c2aa2ee02e8ea6ae79', 'request_id': 'req-987af117-f62c-4619-8e0b-5bd4d64b7307'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.784444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] The token cache is being invalidate because project f894fc36cb1043c2aa2ee02e8ea6ae79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:52.784444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.788004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-987af117-f62c-4619-8e0b-5bd4d64b7307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:52.795754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 824/1679] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:52 2022] DELETE /identity/v3/projects/f894fc36cb1043c2aa2ee02e8ea6ae79 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:52.797727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62a8e9-7ffc-4ffa-8dd9-773befd48e5e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:52.797727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62a8e9-7ffc-4ffa-8dd9-773befd48e5e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:52.797918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62a8e9-7ffc-4ffa-8dd9-773befd48e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:52.820491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:52.824518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70adf48-e434-4a0c-b8c7-cefb164d7478 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:52.848406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1d62a8e9-7ffc-4ffa-8dd9-773befd48e5e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:52.849715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1d62a8e9-7ffc-4ffa-8dd9-773befd48e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.917433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:52.948136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:52.949169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:52.949282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:52.949638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:52.960600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:52.995563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 825/1680] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:52.997494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:52.997494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:52.997670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.072322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:53.073477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:53.094282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 826/1681] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:53.094869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.098995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:53.103860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.110473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.130373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 856/1682] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:53.136474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.144811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76952600-5184-4e46-8882-fc82fe8eaab3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.160553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19322ba2-0d49-40af-8d7e-3e1ab6120fa6 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.168090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.168779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.169260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.169526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] PATH_INFO: `/v3/users/06c8ab149f6a45c98ca6e53fe89baca3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.176155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.176914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.177297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.177665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.178495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:53.178916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.182269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c8ab149f6a45c98ca6e53fe89baca3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.184274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.201339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d6f7-e9ed-41bb-bd11-81b99ed47e56 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.235832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 857/1683] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:53.235832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.240612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.241228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.321888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:53.324346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c8ab149f6a45c98ca6e53fe89baca3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:53.326672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c8ab149f6a45c98ca6e53fe89baca3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:53.327861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:53.328254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c8ab149f6a45c98ca6e53fe89baca3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:53.347248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c8ab149f6a45c98ca6e53fe89baca3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:53.351020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 858/1684] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:53.351020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.354546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:53.365799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c8ab149f6a45c98ca6e53fe89baca3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:53.381161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9768a-2118-4120-aba8-7837dea70b67 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.394004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.395861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.396549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.396952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.398578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.402337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.416137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 827/1685] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:53 2022] DELETE /identity/v3/users/06c8ab149f6a45c98ca6e53fe89baca3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:53.417249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.469686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 859/1686] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:53 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:53.473687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.582310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363789a4-03fe-41ff-9348-0a5558eb039b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.600572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:53.690246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484351b-9320-4b6e-ba04-a9f5058d6517 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.699215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.702296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.702296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.702296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.702296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:53.702913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.705417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.719567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.720210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.720506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.720788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.721428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.726091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.756129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 828/1687] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:53.760979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.777827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 860/1688] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:53 2022] POST /identity/v3/users => generated 303 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:53.785864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.792038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3dab4-158d-417f-8bdc-7c26a2763034 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.810791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e59bd-d8e1-4346-9ff4-e88f727b82c2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:53.812975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.813677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.813956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.814290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.815074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.817406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.826283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:53.828466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:53.830186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:53.831216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:53.833693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:53.847317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:53.873796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 829/1689] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:53 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:53.878279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.901742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 861/1690] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:53.907292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:53.935197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8e0e-6b7f-4f8c-973b-1fe040072e6f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.041680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:54.046580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70095727-1736-44e4-8a18-a7b3ddf71c73 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.059247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.060083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.061989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.062116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.062755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.072345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.080743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.081721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.082150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.082565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.083465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.085230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.098184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 862/1691] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:15:54.102670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.117903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914d6f-eaef-4ff9-a1ad-1e1c6980c84f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.120224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 830/1692] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:53 2022] POST /identity/v3/users => generated 303 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:54.124257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.125558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daa28d-75c6-4679-9d64-e092f0ffc36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.126627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daa28d-75c6-4679-9d64-e092f0ffc36e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.127998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daa28d-75c6-4679-9d64-e092f0ffc36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.128507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daa28d-75c6-4679-9d64-e092f0ffc36e admin admin] PATH_INFO: `/v3/projects/0a860ed6ef544917beead0a6c8ef258b/users/e51be92a560d4bc09098e9b94e9d47d1/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.144785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089c7e-ddb0-4ed6-92bf-092a37a7e975 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.148799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33daa28d-75c6-4679-9d64-e092f0ffc36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a860ed6ef544917beead0a6c8ef258b, user_id=e51be92a560d4bc09098e9b94e9d47d1, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.152280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33daa28d-75c6-4679-9d64-e092f0ffc36e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.154141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.154920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.155229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.155511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.163985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.166568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.183110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 863/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:54 2022] PUT /identity/v3/projects/0a860ed6ef544917beead0a6c8ef258b/users/e51be92a560d4bc09098e9b94e9d47d1/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:54.185408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.185699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.185977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.190457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 831/1694] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:15:54.191565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.219977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba1e2-0eda-4c13-b668-1d3fe65aab11 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.251450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] MFA Rules not processed for user `e51be92a560d4bc09098e9b94e9d47d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:54.252709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:54.381762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.383870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.388829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.388829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.391836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.394957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.415230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 864/1695] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:54.417936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.435765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d1fb-1201-4c9e-b376-68947302184c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.441613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.442351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 832/1696] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:54.443243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.443721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.444147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.445282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.446622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.455099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.470361 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:54.481568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df40a-52ae-4faa-8f39-2f8f0e4151eb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.489870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f69a5f-e82e-40be-a50f-06d6d2e0fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.490744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69a5f-e82e-40be-a50f-06d6d2e0fa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.491897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69a5f-e82e-40be-a50f-06d6d2e0fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.495108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69a5f-e82e-40be-a50f-06d6d2e0fa49 admin admin] PATH_INFO: `/v3/projects/226ec2ccdc08456498fda3ae77484398/users/dc511a972861484688ed8c2a3fa87548/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.529934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 865/1697] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:54 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:15:54.531257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f69a5f-e82e-40be-a50f-06d6d2e0fa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226ec2ccdc08456498fda3ae77484398, user_id=dc511a972861484688ed8c2a3fa87548, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.534355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f69a5f-e82e-40be-a50f-06d6d2e0fa49 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.536889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.563135 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 833/1698] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:54 2022] PUT /identity/v3/projects/226ec2ccdc08456498fda3ae77484398/users/dc511a972861484688ed8c2a3fa87548/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:54.568427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.569061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.569533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.618154 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:54.623811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:54.712195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ce2fe-c525-4d05-a98f-d4bb7bd5275f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.753349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:54.786379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 834/1699] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:15:54.818280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.820225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:54.879525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.881219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.881564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.883830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.884251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.886291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:54.952804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 866/1700] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:54 2022] POST /identity/v3/users => generated 309 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:54.954142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:54.961273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea94dc-6a52-49ae-b0d8-bb9fe56e8fd2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.970995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.971831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.972070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43816-befb-4c86-8e40-49cf8986d129 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:54.972518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.974181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.987554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:54.988278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:54.988616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:54.988965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:54.989755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:54.997931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.011413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.013147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.018291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 867/1701] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:15:55.023178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.043609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 835/1702] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:15:55.045286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4903d2-8854-4af9-b829-e679c3cae6d5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:55.064172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:55.064945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.065297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.065583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] PATH_INFO: `/v3/projects/81c5c3a9ac0247969fb1173207839048/users/b65455f9a0604975b042cbefd3c5bc54/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.094163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c5c3a9ac0247969fb1173207839048, user_id=b65455f9a0604975b042cbefd3c5bc54, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.096997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.146676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 868/1703] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:55 2022] PUT /identity/v3/projects/81c5c3a9ac0247969fb1173207839048/users/b65455f9a0604975b042cbefd3c5bc54/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:55.147857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.167007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.170146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:55.175998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3457-5ede-4cac-a4a4-d641e1b8e85d service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:55.296648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:55.299692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.299977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.300379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.301746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.306909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.312548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697bf8-117b-42cb-8e3b-ef63387f5a92 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:55.323677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:55.324345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.325886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.325886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] PATH_INFO: `/v3/users/df32f6fe92df4a24aa90d35573d579aa` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.329641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df32f6fe92df4a24aa90d35573d579aa)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.330288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 836/1704] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:55.332951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.333372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.356768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae9c3-f030-4703-b88e-0784179fa036 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:55.369654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4ae2d-43f5-4115-9d85-fe0b7b4be8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:55.370325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4ae2d-43f5-4115-9d85-fe0b7b4be8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.370912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4ae2d-43f5-4115-9d85-fe0b7b4be8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.372597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4ae2d-43f5-4115-9d85-fe0b7b4be8e4 admin admin] PATH_INFO: `/v3/projects/81c5c3a9ac0247969fb1173207839048/users/b65455f9a0604975b042cbefd3c5bc54/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.381564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4ae2d-43f5-4115-9d85-fe0b7b4be8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c5c3a9ac0247969fb1173207839048, user_id=b65455f9a0604975b042cbefd3c5bc54, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.384483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4ae2d-43f5-4115-9d85-fe0b7b4be8e4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.409573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 837/1705] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:55 2022] PUT /identity/v3/projects/81c5c3a9ac0247969fb1173207839048/users/b65455f9a0604975b042cbefd3c5bc54/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:55.429241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.429533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.429812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.448924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df32f6fe92df4a24aa90d35573d579aa'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:55.453057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df32f6fe92df4a24aa90d35573d579aa'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:55.453869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df32f6fe92df4a24aa90d35573d579aa'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:55.471356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:55.471903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df32f6fe92df4a24aa90d35573d579aa'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:55.494373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5433717c-900b-4b0c-a13b-6d85f5a780e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df32f6fe92df4a24aa90d35573d579aa'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:55.497829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:55.514519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] MFA Rules not processed for user `b65455f9a0604975b042cbefd3c5bc54`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:55.516015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 869/1706] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:55 2022] DELETE /identity/v3/users/df32f6fe92df4a24aa90d35573d579aa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:55.518217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:55.521155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.521439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.522853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.566004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:55.568651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:55.662099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 870/1707] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:15:55.691032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 838/1708] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:55.692951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.694383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:55.699553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.712049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:55.929537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830839a8-f293-41d5-8e9f-c332bf8caea2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:55.939019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f80be3-b0b3-4678-95d0-86803943ef13 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:55.943606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf58f7-f1ad-49e5-b5cc-19038ce9b62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:55.944168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:55.944323 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf58f7-f1ad-49e5-b5cc-19038ce9b62d service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.944525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf58f7-f1ad-49e5-b5cc-19038ce9b62d service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.945058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:55.945172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf58f7-f1ad-49e5-b5cc-19038ce9b62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.945352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:55.945606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:55.969378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.971009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.972422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf58f7-f1ad-49e5-b5cc-19038ce9b62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:55.974056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf58f7-f1ad-49e5-b5cc-19038ce9b62d service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:55.986636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 871/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:55.987294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:55.988751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.000900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 839/1710] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:56.002704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.002993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.003296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.048661 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d438-7bf9-4e0c-a279-7fa820275c95 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:56.073610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:56.074756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.075796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.076337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] PATH_INFO: `/v3/projects/e36c4ca225cf4a1ea68bc023874f2e6e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.079534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36c4ca225cf4a1ea68bc023874f2e6e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:56.082094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:56.084739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] MFA Rules not processed for user `f7f6100716724f508cedd401d3203aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:56.088183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.222437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36c4ca225cf4a1ea68bc023874f2e6e', 'request_id': 'req-52ff223e-aac7-405c-9115-21b6e2bd6c8c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.230424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36c4ca225cf4a1ea68bc023874f2e6e', 'request_id': 'req-52ff223e-aac7-405c-9115-21b6e2bd6c8c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.252458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36c4ca225cf4a1ea68bc023874f2e6e', 'request_id': 'req-52ff223e-aac7-405c-9115-21b6e2bd6c8c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.261829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 840/1711] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:56.263890 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:56.267299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.278606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] The token cache is being invalidate because project e36c4ca225cf4a1ea68bc023874f2e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:56.279061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.280580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-52ff223e-aac7-405c-9115-21b6e2bd6c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.283868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 872/1712] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:55 2022] DELETE /identity/v3/projects/e36c4ca225cf4a1ea68bc023874f2e6e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:56.286583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b38cc-45bf-4225-9023-807cdb7338f3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.287577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b38cc-45bf-4225-9023-807cdb7338f3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.289274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b38cc-45bf-4225-9023-807cdb7338f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.306357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc3b46-3cb0-430e-ac8e-62ed0802041f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:56.341521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-172b38cc-45bf-4225-9023-807cdb7338f3 None None] MFA Rules not processed for user `f7f6100716724f508cedd401d3203aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:56.343582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-172b38cc-45bf-4225-9023-807cdb7338f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.373387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:56.376501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:56.461842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:56.463002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.463338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.463617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] PATH_INFO: `/v3/users/e51be92a560d4bc09098e9b94e9d47d1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.464981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51be92a560d4bc09098e9b94e9d47d1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:56.468846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:56.487558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 873/1713] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:56.488973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.489368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.489745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.561686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51be92a560d4bc09098e9b94e9d47d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.562425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51be92a560d4bc09098e9b94e9d47d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.563245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51be92a560d4bc09098e9b94e9d47d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.577857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51be92a560d4bc09098e9b94e9d47d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.578386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:56.580109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.595007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a985f11-1fba-42c2-a5ec-310348537827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51be92a560d4bc09098e9b94e9d47d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:56.598492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 874/1714] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:56.600330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:56.607897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.629874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 841/1715] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:56 2022] DELETE /identity/v3/users/e51be92a560d4bc09098e9b94e9d47d1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:56.631725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2be96-b51f-476f-8ffd-1b7e3b7ed3d0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.632182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2be96-b51f-476f-8ffd-1b7e3b7ed3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.632719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2be96-b51f-476f-8ffd-1b7e3b7ed3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.660846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-acd2be96-b51f-476f-8ffd-1b7e3b7ed3d0 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:56.662374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-acd2be96-b51f-476f-8ffd-1b7e3b7ed3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.809102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 842/1716] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:56.810316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:56.815011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:56.815450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:56.866233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20cca8-e697-474d-a263-43dc36250620 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:56.870323 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:56.874618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.894060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 843/1717] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:56.894967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:56.899803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:56.992987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:57.018895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1127-67e7-4bec-9af8-5243f7441b36 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.024259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.025019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.025410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.025792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.027827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:57.059088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.060461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.060836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.061211 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.066939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:57.134474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.136717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.156444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 844/1718] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:57.157407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.192426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7ea97-888c-46f1-afc4-32e0857d5b7d service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.195309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:57.204638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.205269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.205554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.205834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.206537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:15:57.206841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.208541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.215712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.217050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.240928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 875/1719] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:57.244191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.246536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:57.268912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 845/1720] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:15:57.269796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.276317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:57.315076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6973c68-da62-4caa-837d-ec90248f8547 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.333614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.334488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.335455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.345559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] PATH_INFO: `/v3/projects/af8a10afff4b492c9277af86ef1b5770` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.351561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8a10afff4b492c9277af86ef1b5770)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.353739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.393571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8316-c910-45d0-a2cd-b33e8196731b service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.401596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.404115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.404570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.404856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.433514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.436899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.463003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 876/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:57.466923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.497013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672abc-7ea3-4684-9670-c3ddcac9ba57 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.527687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8a10afff4b492c9277af86ef1b5770', 'request_id': 'req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.551444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8a10afff4b492c9277af86ef1b5770', 'request_id': 'req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.594306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8a10afff4b492c9277af86ef1b5770', 'request_id': 'req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.643873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] The token cache is being invalidate because project af8a10afff4b492c9277af86ef1b5770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:57.644397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.645270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.647405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 846/1722] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:57 2022] DELETE /identity/v3/projects/af8a10afff4b492c9277af86ef1b5770 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:57.652125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.652885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.654216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.654497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.654763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.655554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:57.655678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.661236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.679563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd9e12-9dbf-4c9e-9671-a5e3da88372a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.690071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.702081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.703306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.703803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] PATH_INFO: `/v3/users/217a49af9f434eef80e51cdab73ace66` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.716626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] RBAC: Authorizing `identity:delete_user(user_id=217a49af9f434eef80e51cdab73ace66)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.720033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.733932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 877/1723] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:57 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:57.734994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.736920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:57.858907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217a49af9f434eef80e51cdab73ace66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.859907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217a49af9f434eef80e51cdab73ace66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.860894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217a49af9f434eef80e51cdab73ace66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.871215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:57.883802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217a49af9f434eef80e51cdab73ace66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.901180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218d450-3fea-4e43-81b3-f90954f445e4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:57.908419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217a49af9f434eef80e51cdab73ace66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:57.911628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:57.914291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:57.914657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:57.915008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:57.916898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:57.919669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:57.956368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 878/1724] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:57 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:15:57.960793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:57.962448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 847/1725] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:15:57 2022] DELETE /identity/v3/users/217a49af9f434eef80e51cdab73ace66 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:57.967784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:58.001257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d389e5-2d3d-40c8-b77b-77445d477620 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:58.007094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:58.089233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:58.090178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.090581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.092021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.093412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:58.096726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:58.118383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 879/1726] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:58.123727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.145928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea6afe-1288-493a-a3d0-43bf9e8a062f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:58.151777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26595c0-7c1f-4a0b-abb9-b8270a26eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:58.152487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26595c0-7c1f-4a0b-abb9-b8270a26eb0d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.152838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26595c0-7c1f-4a0b-abb9-b8270a26eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.153164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26595c0-7c1f-4a0b-abb9-b8270a26eb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.153901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26595c0-7c1f-4a0b-abb9-b8270a26eb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:58.155721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26595c0-7c1f-4a0b-abb9-b8270a26eb0d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:58.227672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 848/1727] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:58.235785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.248385 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abf998-5884-407d-84df-c6d455fd86a9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:58.253826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e092a-4c0d-474b-b1dd-e6fc7bd59a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:58.254833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e092a-4c0d-474b-b1dd-e6fc7bd59a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.255789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e092a-4c0d-474b-b1dd-e6fc7bd59a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.256292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e092a-4c0d-474b-b1dd-e6fc7bd59a0e admin admin] PATH_INFO: `/v3/projects/e36369321b0c4e9db77e821e679fc03a/users/e92e7de907b047f09766a53ffbfda3fc/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.277225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e092a-4c0d-474b-b1dd-e6fc7bd59a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36369321b0c4e9db77e821e679fc03a, user_id=e92e7de907b047f09766a53ffbfda3fc, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:58.280741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e092a-4c0d-474b-b1dd-e6fc7bd59a0e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:58.303272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 880/1728] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:58 2022] PUT /identity/v3/projects/e36369321b0c4e9db77e821e679fc03a/users/e92e7de907b047f09766a53ffbfda3fc/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:58.315847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.316823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.316823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.358978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] MFA Rules not processed for user `e92e7de907b047f09766a53ffbfda3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:58.360727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:58.396631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c628c-ac0c-4739-ae55-c584414d8541 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.397023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c628c-ac0c-4739-ae55-c584414d8541 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.397382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c628c-ac0c-4739-ae55-c584414d8541 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.399997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 881/1729] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 05:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:15:58.406139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.406689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.407042 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.481009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:58.484809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:58.487622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 849/1730] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:58.489176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.599186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 882/1731] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:15:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:15:58.633223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333a1be-3940-4e14-b81b-11b6a2cdada8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:58.640738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.642841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:58.647391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:58.648873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.649661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.650190 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.651230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:58.656441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:58.665222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f1c2b-1f68-4684-896b-3f3800b69e5d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:58.680179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de3da3-5e6c-4622-82bd-b9588e90a647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:58.681166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de3da3-5e6c-4622-82bd-b9588e90a647 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.681725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de3da3-5e6c-4622-82bd-b9588e90a647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.683010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de3da3-5e6c-4622-82bd-b9588e90a647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.706054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de3da3-5e6c-4622-82bd-b9588e90a647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:58.711021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de3da3-5e6c-4622-82bd-b9588e90a647 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:58.733521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 850/1732] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:58 2022] POST /identity/v3/projects => generated 391 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:58.738528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 883/1733] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:15:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:15:58.740104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.742629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.743475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.745415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.808433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] MFA Rules not processed for user `dc511a972861484688ed8c2a3fa87548`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:58.812713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:58.820778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:58.894182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3a13-ba08-4a12-9124-b7ae7d553762 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:58.913073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:58.913708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:58.913985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:58.914256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:58.914928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:58.917451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:58.919380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:58.941122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 884/1734] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:58.946417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.950833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:58.959328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 851/1735] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:58 2022] POST /identity/v3/users => generated 302 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:58.963496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:58.993946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ce639-c043-4a2b-b3fe-6e858ebb85b4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:59.002998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14043162-4398-43a7-b247-c3ef3bbeb094 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:59.008400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:59.009420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:59.013143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:59.013532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:59.017131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:59.021238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:59.023319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:59.023891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:59.024948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:59.025640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:59.034018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:59.038170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:59.064563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 852/1736] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:15:59.066875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:59.068900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:59.104038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 885/1737] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:15:58 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:15:59.104038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:59.107318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1652ca3-d49e-48f3-bf0c-3bee1172f75e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:59.216097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:59.217310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:59.218099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:59.218542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] PATH_INFO: `/v3/projects/0a860ed6ef544917beead0a6c8ef258b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:59.220508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a860ed6ef544917beead0a6c8ef258b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:59.222539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:59.384370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27429-7401-4214-aea7-aec7b681c427 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:59.399402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a860ed6ef544917beead0a6c8ef258b', 'request_id': 'req-10148807-3507-43e8-91ea-a081ceba6b1a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:59.422674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a860ed6ef544917beead0a6c8ef258b', 'request_id': 'req-10148807-3507-43e8-91ea-a081ceba6b1a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:59.462829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a860ed6ef544917beead0a6c8ef258b', 'request_id': 'req-10148807-3507-43e8-91ea-a081ceba6b1a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:59.503412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] The token cache is being invalidate because project 0a860ed6ef544917beead0a6c8ef258b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:15:59.505688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:59.508737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:15:59.511729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 853/1738] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:59 2022] DELETE /identity/v3/projects/0a860ed6ef544917beead0a6c8ef258b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:59.513379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:59.517264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:59.550694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62558c-ede2-4ca8-9e3e-d3e40476cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:59.551483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62558c-ede2-4ca8-9e3e-d3e40476cf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:59.551746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62558c-ede2-4ca8-9e3e-d3e40476cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:59.552025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62558c-ede2-4ca8-9e3e-d3e40476cf56 admin admin] PATH_INFO: `/v3/projects/e4581b33f95c4348b273f7d3f6c8b012/users/a865806d56c44879bd5be5642151e42b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:59.611518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62558c-ede2-4ca8-9e3e-d3e40476cf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4581b33f95c4348b273f7d3f6c8b012, user_id=a865806d56c44879bd5be5642151e42b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:59.621067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62558c-ede2-4ca8-9e3e-d3e40476cf56 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:15:59.669062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 886/1739] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:15:59 2022] PUT /identity/v3/projects/e4581b33f95c4348b273f7d3f6c8b012/users/a865806d56c44879bd5be5642151e42b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:15:59.670463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:59.670755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:59.675383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:59.685355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:59.744298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] MFA Rules not processed for user `386a456c559546bcbecc0181ce656a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:15:59.745543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:59.757739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10148807-3507-43e8-91ea-a081ceba6b1a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:15:59.938254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 887/1740] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:15:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:15:59.939416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:15:59.941276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:15:59.953356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:59.973005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:15:59.973696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:15:59.974333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:15:59.974694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:15:59.975558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:15:59.983247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:00.047058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 854/1741] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:15:59 2022] POST /identity/v3/users => generated 307 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:00.047058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:00.047058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.067640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efd8fb-37c8-4dff-8582-32fefd5adb33 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:00.077458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:00.078120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.078400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.078641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8fa7-0dd1-4d95-83ab-91a0ca5b2aa4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:00.078761 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] PATH_INFO: `/v3/users/b65455f9a0604975b042cbefd3c5bc54` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.080070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65455f9a0604975b042cbefd3c5bc54)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:00.083454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:00.089447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:00.091107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.091579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.091999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] PATH_INFO: `/v3/projects/107049e3d7884960834eb9ebf8419c88` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.094415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] RBAC: Authorizing `identity:delete_project(project_id=107049e3d7884960834eb9ebf8419c88)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:00.096560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:00.192239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65455f9a0604975b042cbefd3c5bc54'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.193070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65455f9a0604975b042cbefd3c5bc54'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.193690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65455f9a0604975b042cbefd3c5bc54'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.212470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65455f9a0604975b042cbefd3c5bc54'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.214256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107049e3d7884960834eb9ebf8419c88', 'request_id': 'req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.224196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107049e3d7884960834eb9ebf8419c88', 'request_id': 'req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.225932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f5101842-c8c4-424f-8123-1d59198ecf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65455f9a0604975b042cbefd3c5bc54'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.233723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107049e3d7884960834eb9ebf8419c88', 'request_id': 'req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.254095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] The token cache is being invalidate because project 107049e3d7884960834eb9ebf8419c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:00.254535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.255519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:00.260165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 888/1742] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:15:59 2022] DELETE /identity/v3/projects/107049e3d7884960834eb9ebf8419c88 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:00.260774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:00.264315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.269479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 855/1743] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:00 2022] DELETE /identity/v3/users/b65455f9a0604975b042cbefd3c5bc54 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:00.273829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f73f0-bfd4-46c8-b1bb-6d1df056ce09 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.274115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f73f0-bfd4-46c8-b1bb-6d1df056ce09 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.274389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f73f0-bfd4-46c8-b1bb-6d1df056ce09 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.281584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 856/1744] 10.222.0.27 () {54 vars in 961 bytes} [Fri Aug 5 05:16:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:16:00.282906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.283231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.283510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.321778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] MFA Rules not processed for user `20bd2f5da95a4d029adbe7b1e0f75bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:00.323623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.382486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:00.419269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89975-4e5c-48ed-8fb1-3ee6ec42599a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:00.470677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 857/1745] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:00.472345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:00.475691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.531882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:00.584696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a091c-44a2-4c43-8141-3fe23466c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:00.587142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a091c-44a2-4c43-8141-3fe23466c8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.588110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a091c-44a2-4c43-8141-3fe23466c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.590830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a091c-44a2-4c43-8141-3fe23466c8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.592163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a091c-44a2-4c43-8141-3fe23466c8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:00.597026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a091c-44a2-4c43-8141-3fe23466c8b0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:00.621560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 889/1746] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:00.626477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e96f6-b7c0-4ecb-8fcf-a6461c5cfe61 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.626770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e96f6-b7c0-4ecb-8fcf-a6461c5cfe61 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.627085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e96f6-b7c0-4ecb-8fcf-a6461c5cfe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.660602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-422e96f6-b7c0-4ecb-8fcf-a6461c5cfe61 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:00.661551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-422e96f6-b7c0-4ecb-8fcf-a6461c5cfe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.672301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e17f7d-7d6c-4db3-a45f-8f8d56611a14 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:00.687626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 890/1747] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:00.689051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505b1b-4195-465c-b6ff-d7f70a9e5f20 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.689351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505b1b-4195-465c-b6ff-d7f70a9e5f20 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.689633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505b1b-4195-465c-b6ff-d7f70a9e5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.697007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10cae3-4a62-470b-ac33-4771f3145d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:00.698713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10cae3-4a62-470b-ac33-4771f3145d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.699500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10cae3-4a62-470b-ac33-4771f3145d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.710645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10cae3-4a62-470b-ac33-4771f3145d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.713556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10cae3-4a62-470b-ac33-4771f3145d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:00.718762 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10cae3-4a62-470b-ac33-4771f3145d41 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:00.724074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-01505b1b-4195-465c-b6ff-d7f70a9e5f20 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:00.727624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-01505b1b-4195-465c-b6ff-d7f70a9e5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.751411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 858/1748] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:00.757632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.764810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.765218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.804985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] MFA Rules not processed for user `20bd2f5da95a4d029adbe7b1e0f75bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:00.811831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:00.835649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 859/1749] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:00.836834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:00.861440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0960-968b-42fb-992e-d8f7d330c2d7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:00.885142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:00.885835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.886117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.886389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] PATH_INFO: `/v3/projects/e4581b33f95c4348b273f7d3f6c8b012/users/a865806d56c44879bd5be5642151e42b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.894044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4581b33f95c4348b273f7d3f6c8b012, user_id=a865806d56c44879bd5be5642151e42b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:00.896777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:00.927034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 891/1750] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Aug 5 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:00.938533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 860/1751] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:00 2022] PUT /identity/v3/projects/e4581b33f95c4348b273f7d3f6c8b012/users/a865806d56c44879bd5be5642151e42b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:00.938748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:00.938748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:00.938913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:00.939011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:00.982456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:00.986834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.071244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc9ff-2471-407e-9362-32f830fe1b50 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.079392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 892/1752] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:01.079392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.079392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.090139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.091434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.091729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.092007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] PATH_INFO: `/v3/projects/3d43b44ccaf444ceb5ca169c31f59bd1/users/4cba23a3ce674ba7a734c613e76d6427/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.212194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d43b44ccaf444ceb5ca169c31f59bd1, user_id=4cba23a3ce674ba7a734c613e76d6427, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:01.217835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:01.240129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 861/1753] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:00 2022] PUT /identity/v3/projects/3d43b44ccaf444ceb5ca169c31f59bd1/users/4cba23a3ce674ba7a734c613e76d6427/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:01.240867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.261164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9ccf-ee6a-4b25-bd61-26ad6091cedb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.272639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:01.361974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:01.413758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26e28-cb3f-4efd-9ec9-fd73f124b574 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.423626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.424775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.425073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.425467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.427956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.441694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.442695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.443129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.443659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.447516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:01.447924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f3143-3757-47d2-bf5c-46592a409341 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:01.487104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 862/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:01.491628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.492175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.492510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.541809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] MFA Rules not processed for user `a865806d56c44879bd5be5642151e42b`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:01.543186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.584540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:01.586370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:01.599034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 893/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:01.600400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.601958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.651652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 863/1756] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:01.652715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.676192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a592a0-5267-45a8-96bf-786705a85b65 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.685806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.686637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.687414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.688425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] PATH_INFO: `/v3/projects/81c5c3a9ac0247969fb1173207839048` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.691980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c5c3a9ac0247969fb1173207839048)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:01.694131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:01.739273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a800b-6379-451a-ad25-034c0ab89375 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.765294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:01.768240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c5c3a9ac0247969fb1173207839048', 'request_id': 'req-31b31c49-aa45-46f7-ac3f-74abff2ad88a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:01.776173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c5c3a9ac0247969fb1173207839048', 'request_id': 'req-31b31c49-aa45-46f7-ac3f-74abff2ad88a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:01.786085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c5c3a9ac0247969fb1173207839048', 'request_id': 'req-31b31c49-aa45-46f7-ac3f-74abff2ad88a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:01.810448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] The token cache is being invalidate because project 81c5c3a9ac0247969fb1173207839048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:01.810978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:01.811902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:01.814820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 894/1757] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:01 2022] DELETE /identity/v3/projects/81c5c3a9ac0247969fb1173207839048 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:01.818115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.818115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.840210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.841443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.841879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.842319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.843276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:01.843710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:01.845450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:01.849364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:01.864989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 864/1758] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:01.866933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.870750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.915602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31c49-aa45-46f7-ac3f-74abff2ad88a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.921717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.922591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.923064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.923372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.924098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:01.926009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:01.941375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 895/1759] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:01.941375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:01.944380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:01.972227 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ddedd-e81d-49e5-b5fe-be003a497cad admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:01.978893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:01.979633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:01.980069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:01.980353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:01.983009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.001437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.002444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d27813-8735-43c8-8b66-bd07c2deb1cd service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.024922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 865/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:02.026324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.026707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.027929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.048634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a3a32-ed19-48c7-8e51-84730549e951 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.053948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:02.055549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.058347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:02.059839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.062231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.062443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.066250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 866/1761] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:02.067260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.067723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.073315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.103864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3b13-10a7-4ac6-bea3-d3b994435762 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.116191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:02.116932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.117672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.117952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.118624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.125435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.184871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.186716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457044fb-9e16-45b4-bf24-0bdfe302302b service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.202888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 867/1762] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:02 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:02.204078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.217765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 896/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:02.219320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.219685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.219939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.268643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:02.272158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.318131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:02.343990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d491b-33cd-4525-bd36-6aa1bdf01679 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.357941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd250d-62f9-44d7-b7ca-cb1021c42864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:02.358637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd250d-62f9-44d7-b7ca-cb1021c42864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.358922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd250d-62f9-44d7-b7ca-cb1021c42864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.359232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd250d-62f9-44d7-b7ca-cb1021c42864 admin admin] PATH_INFO: `/v3/projects/3d43b44ccaf444ceb5ca169c31f59bd1/users/4cba23a3ce674ba7a734c613e76d6427/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.361880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd250d-62f9-44d7-b7ca-cb1021c42864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d43b44ccaf444ceb5ca169c31f59bd1, user_id=4cba23a3ce674ba7a734c613e76d6427, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.367513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd250d-62f9-44d7-b7ca-cb1021c42864 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.383103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 868/1764] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:02 2022] PUT /identity/v3/projects/3d43b44ccaf444ceb5ca169c31f59bd1/users/4cba23a3ce674ba7a734c613e76d6427/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:02.384716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd6bf-321f-4b80-8659-9d6a105eb9c2 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.386367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd6bf-321f-4b80-8659-9d6a105eb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.386481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd6bf-321f-4b80-8659-9d6a105eb9c2 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.388894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 869/1765] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 05:16:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:16:02.389624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bd6bf-321f-4b80-8659-9d6a105eb9c2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.446789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 897/1766] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:02.448467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.492480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:02.532562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bd6bf-321f-4b80-8659-9d6a105eb9c2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.549994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658ff35-26a6-425c-9184-43610e5b1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:02.550897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658ff35-26a6-425c-9184-43610e5b1917 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.551404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658ff35-26a6-425c-9184-43610e5b1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.551782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658ff35-26a6-425c-9184-43610e5b1917 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.553014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658ff35-26a6-425c-9184-43610e5b1917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.565894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658ff35-26a6-425c-9184-43610e5b1917 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.582409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0c583-7ef8-4650-bef9-f37e8237495e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.622536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 870/1767] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:02 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:02.626874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.626874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.628011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.687004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:02.688523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.753014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:02.754417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.755772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.755772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.763501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.827213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 871/1768] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:02.837119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.864224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592ae70-d8a7-4638-80eb-f64ac51ecfa8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.882603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:02.883306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:02.883619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:02.883974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:02.884842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:02.885171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.887014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.920222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 872/1769] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:02.920222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.927935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:02.929674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:02.965072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 898/1770] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:02.968508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540dd87-74ab-4f45-b1f9-f311f8dad5f9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.970213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:02.972876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:02.993581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9360a-848f-46a6-bdde-89f7986a3ce2 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:02.999519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.003783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.004240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.004376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.004724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.005644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.006000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.007230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.007530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.008921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.033930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.035596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.041280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 873/1771] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:03.042218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.060130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 899/1772] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:03.062811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.070694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53bf04-bd47-4830-984e-c973372dc132 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.085914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.086652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.087057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.087450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.088359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.090015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8df3-9542-4ec4-b051-5e5409ea9b17 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.092297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.102467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.103248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.103631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.104684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.106613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.109735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.132506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 900/1773] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:03.136450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.156586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 874/1774] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:03 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:03.160401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.189280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458a4f6-5403-404f-b136-fed11bb9c636 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.210749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:03.381080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cb6d9-886d-4e05-9276-0bb0183a15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.381954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cb6d9-886d-4e05-9276-0bb0183a15d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.382337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cb6d9-886d-4e05-9276-0bb0183a15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.382711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cb6d9-886d-4e05-9276-0bb0183a15d0 admin admin] PATH_INFO: `/v3/projects/46bb1f5e185e4c318ccd835f837802bd/users/41b8663710774f01a1ef132d7690a141/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.404048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665421a-48fd-4a3d-a922-898997f97a67 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.409291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cb6d9-886d-4e05-9276-0bb0183a15d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bb1f5e185e4c318ccd835f837802bd, user_id=41b8663710774f01a1ef132d7690a141, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.412247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cb6d9-886d-4e05-9276-0bb0183a15d0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.413886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.414521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.415950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.416578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.433174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.435604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 901/1775] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:03 2022] PUT /identity/v3/projects/46bb1f5e185e4c318ccd835f837802bd/users/41b8663710774f01a1ef132d7690a141/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:03.442044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.447933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.448618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.449239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.495607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 875/1776] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:03 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:03.501141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.515796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] MFA Rules not processed for user `41b8663710774f01a1ef132d7690a141`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:03.519379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:03.525378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb444fee-cabc-4a89-b34d-d4b7e85f27f1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.627661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:03.677433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 902/1777] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:03.681816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.715981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.716878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.717484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.718025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.719627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.722337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.750202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 876/1778] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:03.751119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.788551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35678-1df3-4356-9d05-7adf4ed4f2f8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.810936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.813269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.813538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.814950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.815814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.820778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.874518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 877/1779] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:03.878853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b31cf-015b-4dbb-a3d6-fad2531f4efe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.879677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:03.900375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.901332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.901862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.902365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:03.904582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:03.910393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633cc7-f021-44d5-b2fc-f808e2a07139 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:03.912128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:03.946564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3426f3-1fdb-4181-8fe9-d6c9c428da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:03.948662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3426f3-1fdb-4181-8fe9-d6c9c428da9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:03.948662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3426f3-1fdb-4181-8fe9-d6c9c428da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:03.948662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3426f3-1fdb-4181-8fe9-d6c9c428da9a admin admin] PATH_INFO: `/v3/projects/3048c7dc1b634cadbd72a6f1ddd4f6f8/users/c829f5fac9934332ae3660f1f4d52eea/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:04.023802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3426f3-1fdb-4181-8fe9-d6c9c428da9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3048c7dc1b634cadbd72a6f1ddd4f6f8, user_id=c829f5fac9934332ae3660f1f4d52eea, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:04.044684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3426f3-1fdb-4181-8fe9-d6c9c428da9a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:04.046690 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 903/1780] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:03 2022] POST /identity/v3/projects => generated 369 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:04.050055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:04.097427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 878/1781] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:03 2022] PUT /identity/v3/projects/3048c7dc1b634cadbd72a6f1ddd4f6f8/users/c829f5fac9934332ae3660f1f4d52eea/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:04.109844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:04.109844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:04.110221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:04.115301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:04.190269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] MFA Rules not processed for user `c829f5fac9934332ae3660f1f4d52eea`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:04.200822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:04.346181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d703c-c587-4ee1-91bb-30445d6d5d63 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:04.461224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:04.461877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:04.462243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:04.466760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:04.468771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:04.474212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:04.577178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 904/1782] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:04 2022] POST /identity/v3/users => generated 291 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:04.578512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:04.622368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e9ff-5ecc-4ce8-8efd-6889688e5008 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:04.645678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:04.648907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:04.649782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:04.649782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:04.650992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:04.654606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 879/1783] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:04.657208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:04.665346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:04.712500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 905/1784] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:04.718181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db837d16-2fe3-4db7-bcd3-a935c69ec648 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:04.721035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:04.758939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38b4c4-5be3-4ef6-af4c-abd8ffc832bb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:04.766176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:04.769590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:04.772375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:04.773922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:04.775114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:04.775917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:04.777990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:04.778973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] PATH_INFO: `/v3/projects/b6572b36db604a13b4f030a62eeb0488/users/f99ba25441ac4464b4ebc98428f53a3e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:04.779112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:04.788955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:04.869033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6572b36db604a13b4f030a62eeb0488, user_id=f99ba25441ac4464b4ebc98428f53a3e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:04.886196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:04.923651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 906/1785] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:04 2022] PUT /identity/v3/projects/b6572b36db604a13b4f030a62eeb0488/users/f99ba25441ac4464b4ebc98428f53a3e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:04.927431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:04.947814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 880/1786] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:04 2022] POST /identity/v3/projects => generated 365 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:04.948931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:05.123455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a3135-98cf-45e1-8a16-d06994339ec1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:05.133168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf5cf-3a57-4aa6-8e8e-158056f2531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:05.134134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf5cf-3a57-4aa6-8e8e-158056f2531f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.134577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf5cf-3a57-4aa6-8e8e-158056f2531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.134698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf5cf-3a57-4aa6-8e8e-158056f2531f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.135529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf5cf-3a57-4aa6-8e8e-158056f2531f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:05.137334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf5cf-3a57-4aa6-8e8e-158056f2531f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:05.141610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbcf7-9f42-4517-a253-5b2f9b716f95 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:05.158775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:05.160735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.161763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.164766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.165691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:05.170018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:05.176744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 907/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:05.180428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cbc2a-92bf-4b78-b299-78013f800f84 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.180676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cbc2a-92bf-4b78-b299-78013f800f84 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.181330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cbc2a-92bf-4b78-b299-78013f800f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.184507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:05.213646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:05.223181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 881/1788] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:04 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:05.224791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:05.239644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04b5ca-e16b-4b19-a89e-7705c97672d3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:05.252312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:05.253141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.253421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.253854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] PATH_INFO: `/v3/projects/b6572b36db604a13b4f030a62eeb0488/users/f99ba25441ac4464b4ebc98428f53a3e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.262710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6572b36db604a13b4f030a62eeb0488, user_id=f99ba25441ac4464b4ebc98428f53a3e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:05.267741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:05.273569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f85cbc2a-92bf-4b78-b299-78013f800f84 None None] MFA Rules not processed for user `20bd2f5da95a4d029adbe7b1e0f75bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:05.288019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f85cbc2a-92bf-4b78-b299-78013f800f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:05.301753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 882/1789] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:05 2022] PUT /identity/v3/projects/b6572b36db604a13b4f030a62eeb0488/users/f99ba25441ac4464b4ebc98428f53a3e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:05.305092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:05.430153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a07059-053d-416a-ad3c-9bec15ca9eb7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:05.438939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d41890-8e62-408d-ba20-d75a6415ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:05.439665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41890-8e62-408d-ba20-d75a6415ace2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.440308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41890-8e62-408d-ba20-d75a6415ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.440587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41890-8e62-408d-ba20-d75a6415ace2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.441383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d41890-8e62-408d-ba20-d75a6415ace2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:05.443399 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d41890-8e62-408d-ba20-d75a6415ace2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:05.463715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 883/1790] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:05.463715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.463715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.463715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.490877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 908/1791] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:05.492397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.492684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.492961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.588917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:05.590595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:05.601510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] MFA Rules not processed for user `f99ba25441ac4464b4ebc98428f53a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:05.609310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:05.784798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 884/1792] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:16:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:05.785680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:05.836966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac266e-af41-495c-8c1e-25b31655abfd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:05.857943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:05.858576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:05.860404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:05.860682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] PATH_INFO: `/v3/projects/56923d26c2a64abfaf80397822b44425/users/fa3a5f80509242b4b858e3d03c1a7b8a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:05.885124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 909/1793] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:05.911668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56923d26c2a64abfaf80397822b44425, user_id=fa3a5f80509242b4b858e3d03c1a7b8a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:05.916194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:05.941395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 885/1794] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:05 2022] PUT /identity/v3/projects/56923d26c2a64abfaf80397822b44425/users/fa3a5f80509242b4b858e3d03c1a7b8a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:05.942450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:05.959987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05f4fa-94ac-4b1a-be98-7719f5960ce5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:06.014151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:06.091825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:06.141955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:06.143247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:06.143760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:06.144307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:06.145261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:06.147467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:06.161403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 910/1795] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:06.162822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:06.179022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:06.213803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba2e7-6bfe-4bb3-be73-805a5e36ea98 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:06.220504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:06.221279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:06.221509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:06.221843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:06.257185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:06.376197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:06.378629 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:06.405880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 886/1796] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:06.406854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:06.441476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954c7b5-8bf6-424f-a695-8c875cca8c21 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:06.451049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:06.462817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffc398-3016-463c-ad16-499625432ac1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:06.471183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:06.472377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:06.473477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] PATH_INFO: `/v3/projects/56923d26c2a64abfaf80397822b44425/users/fa3a5f80509242b4b858e3d03c1a7b8a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:06.482500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56923d26c2a64abfaf80397822b44425, user_id=fa3a5f80509242b4b858e3d03c1a7b8a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:06.485092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754d664-b3bd-45e5-9b50-9f000ee72066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:06.487648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754d664-b3bd-45e5-9b50-9f000ee72066 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:06.488377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754d664-b3bd-45e5-9b50-9f000ee72066 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:06.490640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754d664-b3bd-45e5-9b50-9f000ee72066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:06.498430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:06.542044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 887/1797] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:06 2022] PUT /identity/v3/projects/56923d26c2a64abfaf80397822b44425/users/fa3a5f80509242b4b858e3d03c1a7b8a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:06.543115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:06.623539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754d664-b3bd-45e5-9b50-9f000ee72066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:06.625995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754d664-b3bd-45e5-9b50-9f000ee72066 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:06.649902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 911/1798] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:16:06.651595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccdb73-6277-434a-9892-a5b864fa2576 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:06.651884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccdb73-6277-434a-9892-a5b864fa2576 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:06.652569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccdb73-6277-434a-9892-a5b864fa2576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:06.781209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351444c-2bef-41f1-854c-97c7cfb02ec8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:06.790921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:06.791600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:06.791882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:06.792162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:06.796531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cfccdb73-6277-434a-9892-a5b864fa2576 None None] MFA Rules not processed for user `fa3a5f80509242b4b858e3d03c1a7b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:06.797755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cfccdb73-6277-434a-9892-a5b864fa2576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:07.084620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:07.086077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:07.138417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 912/1799] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:07.139304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 888/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:07.221636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:07.221925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:07.222201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:07.372179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] MFA Rules not processed for user `4cba23a3ce674ba7a734c613e76d6427`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:07.373628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:07.542470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:07.781749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 913/1801] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:07.924207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:07.926327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:07.953918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd5d56-dd5a-4654-9941-6289b83771c0 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:07.971507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654238-2ff3-46dd-801c-2bb5cce212fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:07.972818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654238-2ff3-46dd-801c-2bb5cce212fa service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:07.973333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654238-2ff3-46dd-801c-2bb5cce212fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:07.973810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654238-2ff3-46dd-801c-2bb5cce212fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:08.000062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654238-2ff3-46dd-801c-2bb5cce212fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:08.004317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654238-2ff3-46dd-801c-2bb5cce212fa service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:08.019679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:08.048670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 889/1802] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:08.644767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:08.665342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f2e5-209c-43cd-839e-67dbcb0a82d3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:08.686372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be145888-4979-418f-b436-61460cabf71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:08.687693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be145888-4979-418f-b436-61460cabf71c service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:08.689959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be145888-4979-418f-b436-61460cabf71c service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:08.690345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be145888-4979-418f-b436-61460cabf71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:08.779423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:08.779736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:08.780125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:08.844328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:08.850118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:08.963967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be145888-4979-418f-b436-61460cabf71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:08.967424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be145888-4979-418f-b436-61460cabf71c service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:09.005918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 914/1803] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:09.040304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 890/1804] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 5 05:16:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:09.479568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be145888-4979-418f-b436-61460cabf71c service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:09.482306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-be145888-4979-418f-b436-61460cabf71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:09.509169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be145888-4979-418f-b436-61460cabf71c service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:09.525641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83983034-28fe-4a3c-b920-173834c8835f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:09.529104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983034-28fe-4a3c-b920-173834c8835f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:09.533240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983034-28fe-4a3c-b920-173834c8835f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:09.533758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983034-28fe-4a3c-b920-173834c8835f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:09.552534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983034-28fe-4a3c-b920-173834c8835f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:09.557988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983034-28fe-4a3c-b920-173834c8835f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:09.581375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 915/1805] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:10.255738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:10.257752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:10.424090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40d9ee-386b-4a49-bb0c-2ce92a0b8a62 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:10.430626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:10.431637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:10.432173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:10.432610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] PATH_INFO: `/v3/users/e92e7de907b047f09766a53ffbfda3fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:10.434852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92e7de907b047f09766a53ffbfda3fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:10.439655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:10.556752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92e7de907b047f09766a53ffbfda3fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:10.558433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92e7de907b047f09766a53ffbfda3fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:10.560825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92e7de907b047f09766a53ffbfda3fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:10.584809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92e7de907b047f09766a53ffbfda3fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:10.626782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92e7de907b047f09766a53ffbfda3fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:10.733047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:10.734029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:10.734466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:10.745727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 891/1806] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:10 2022] DELETE /identity/v3/users/e92e7de907b047f09766a53ffbfda3fc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:10.804135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:10.809730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:11.053490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 916/1807] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:11.328039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:11.331391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:11.401159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:11.474788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4784-56f9-4768-821e-25c72fa429ae admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:11.489967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70e2a-fa41-45ea-a05a-96a5d9faa9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:11.490958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70e2a-fa41-45ea-a05a-96a5d9faa9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:11.493244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70e2a-fa41-45ea-a05a-96a5d9faa9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:11.493897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70e2a-fa41-45ea-a05a-96a5d9faa9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:11.519562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb70e2a-fa41-45ea-a05a-96a5d9faa9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:11.521742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb70e2a-fa41-45ea-a05a-96a5d9faa9f2 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:11.551624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 892/1808] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:12.862795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:12.865939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:12.900223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b1ad-3701-4d19-8eab-670fe6fb4e5b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:12.915791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:12.916673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:12.918340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:12.919356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] PATH_INFO: `/v3/users/41b8663710774f01a1ef132d7690a141` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:12.931318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b8663710774f01a1ef132d7690a141)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:12.935146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:13.035837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:13.042077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b8663710774f01a1ef132d7690a141'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.044022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b8663710774f01a1ef132d7690a141'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.061635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b8663710774f01a1ef132d7690a141'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.068372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b8663710774f01a1ef132d7690a141'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.088983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b8663710774f01a1ef132d7690a141'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.122873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 917/1809] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:12 2022] DELETE /identity/v3/users/41b8663710774f01a1ef132d7690a141 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:13.127481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:13.128729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:13.129165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:13.185416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:13.198462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:13.236886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:13.238543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:13.355303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 893/1810] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:13.399991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:13.403813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:13.448058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e8c2-52a2-4f20-9688-8435fe781905 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:13.471374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:13.472036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:13.473175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:13.473175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] PATH_INFO: `/v3/users/c829f5fac9934332ae3660f1f4d52eea` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:13.478244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c829f5fac9934332ae3660f1f4d52eea)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:13.487241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:13.602254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051251-2be5-401a-ba8e-e632def98a37 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:13.618213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf3d99-f45e-4dde-b0b0-8ecb6aedc872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:13.618940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf3d99-f45e-4dde-b0b0-8ecb6aedc872 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:13.619433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf3d99-f45e-4dde-b0b0-8ecb6aedc872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:13.619842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf3d99-f45e-4dde-b0b0-8ecb6aedc872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:13.630379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c829f5fac9934332ae3660f1f4d52eea'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.631462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c829f5fac9934332ae3660f1f4d52eea'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.632055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c829f5fac9934332ae3660f1f4d52eea'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.649521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf3d99-f45e-4dde-b0b0-8ecb6aedc872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:13.651187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf3d99-f45e-4dde-b0b0-8ecb6aedc872 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:13.667760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c829f5fac9934332ae3660f1f4d52eea'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.680763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 894/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:13.696148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c829f5fac9934332ae3660f1f4d52eea'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:13.729584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 918/1812] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:13 2022] DELETE /identity/v3/users/c829f5fac9934332ae3660f1f4d52eea => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:13.736304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590736d7-01c3-4550-b7de-92ab256854d6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:13.736644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590736d7-01c3-4550-b7de-92ab256854d6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:13.737011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590736d7-01c3-4550-b7de-92ab256854d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:13.785315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-590736d7-01c3-4550-b7de-92ab256854d6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:13.787792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-590736d7-01c3-4550-b7de-92ab256854d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:13.944377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 895/1813] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:14.144555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:14.146143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:14.175561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73e2d0-6c94-4572-b0fa-6646ad9e0bd9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:14.182941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:14.184239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.184664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.184910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] PATH_INFO: `/v3/projects/e36369321b0c4e9db77e821e679fc03a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.186282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36369321b0c4e9db77e821e679fc03a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:14.188298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:14.200777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774314fa-e170-48d0-97f1-39650ec06533 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.202055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774314fa-e170-48d0-97f1-39650ec06533 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.203054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774314fa-e170-48d0-97f1-39650ec06533 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.205521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 896/1814] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:16:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:16:14.248851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774314fa-e170-48d0-97f1-39650ec06533 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:14.251104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-774314fa-e170-48d0-97f1-39650ec06533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:14.262666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:14.275097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36369321b0c4e9db77e821e679fc03a', 'request_id': 'req-77b19549-a4c0-40fe-b323-6a10c621baa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.284123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36369321b0c4e9db77e821e679fc03a', 'request_id': 'req-77b19549-a4c0-40fe-b323-6a10c621baa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.289188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774314fa-e170-48d0-97f1-39650ec06533 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:14.294461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36369321b0c4e9db77e821e679fc03a', 'request_id': 'req-77b19549-a4c0-40fe-b323-6a10c621baa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.321095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] The token cache is being invalidate because project e36369321b0c4e9db77e821e679fc03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:14.321399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.322829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.325781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:14.327520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 919/1815] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:14 2022] DELETE /identity/v3/projects/e36369321b0c4e9db77e821e679fc03a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:14.328952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:14.331952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:14.412095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b19549-a4c0-40fe-b323-6a10c621baa9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:14.416353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:14.417068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.417416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.417754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.425853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:14.504679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:14.505305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.505643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.505970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] PATH_INFO: `/v3/users/43d6fde08d4f48aaa82264dbda4dae57` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.508121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d6fde08d4f48aaa82264dbda4dae57)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:14.510127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:14.642521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:14.646173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:14.664892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d6fde08d4f48aaa82264dbda4dae57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.665662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d6fde08d4f48aaa82264dbda4dae57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.668436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d6fde08d4f48aaa82264dbda4dae57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.672619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 920/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:14.673505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:14.676678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:14.685791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d6fde08d4f48aaa82264dbda4dae57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.702520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f434c-fabb-40b5-8ec8-0d40f8d7b3e8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:14.707884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7a289817-0fb8-4519-9ff4-9c48eec67bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d6fde08d4f48aaa82264dbda4dae57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.719912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:14.720723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.721008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.721390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] PATH_INFO: `/v3/users/a865806d56c44879bd5be5642151e42b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.722593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a865806d56c44879bd5be5642151e42b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:14.724664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:14.750719 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 897/1817] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:14 2022] DELETE /identity/v3/users/43d6fde08d4f48aaa82264dbda4dae57 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:14.752523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.752814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.753092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.804788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:14.806115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:14.867908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a865806d56c44879bd5be5642151e42b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.868900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a865806d56c44879bd5be5642151e42b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.869739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a865806d56c44879bd5be5642151e42b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.887684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a865806d56c44879bd5be5642151e42b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.891743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:14.905806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d8d1cea4-558a-4fec-83d7-bc96acbd2e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a865806d56c44879bd5be5642151e42b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:14.942396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 921/1818] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:14 2022] DELETE /identity/v3/users/a865806d56c44879bd5be5642151e42b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:14.946095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:14.948458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:14.949535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:14.985194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 898/1819] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:15.021758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:15.023714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:15.194823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 922/1820] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:15.204156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:15.206447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:15.231952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21631e4-fabd-495e-ac4b-676c88b3d2d4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:15.256077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:15.257976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:15.334021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:15.415029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:15.416019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:15.416019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:15.421438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:15.432629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11001c50-cf4c-4e2c-bdf1-31221a3dff79 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:15.444346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175c60-79cf-42be-94e3-c9a8f6426750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:15.450332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175c60-79cf-42be-94e3-c9a8f6426750 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:15.450721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175c60-79cf-42be-94e3-c9a8f6426750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:15.451174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175c60-79cf-42be-94e3-c9a8f6426750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:15.459559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:15.468721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:15.502275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175c60-79cf-42be-94e3-c9a8f6426750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:15.503817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175c60-79cf-42be-94e3-c9a8f6426750 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:15.505106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 899/1821] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:15.517397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 923/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:16.401820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:16.404666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:16.415372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285845b9-aadb-44e1-bd7f-87fe39389303 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:16.415949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285845b9-aadb-44e1-bd7f-87fe39389303 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:16.415949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285845b9-aadb-44e1-bd7f-87fe39389303 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:16.417629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 924/1823] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:16:16.428805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6be1-3d21-4046-ae46-90cb562a2e87 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:16.435096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:16.435572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:16.435860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:16.458891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:16.460322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:16.460616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:16.460894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] PATH_INFO: `/v3/projects/46bb1f5e185e4c318ccd835f837802bd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:16.463931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bb1f5e185e4c318ccd835f837802bd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:16.476624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:16.489156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:16.491970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:16.679247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bb1f5e185e4c318ccd835f837802bd', 'request_id': 'req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:16.706635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bb1f5e185e4c318ccd835f837802bd', 'request_id': 'req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:16.716601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bb1f5e185e4c318ccd835f837802bd', 'request_id': 'req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:16.745820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 925/1824] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:16:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:16.747499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:16.751603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] The token cache is being invalidate because project 46bb1f5e185e4c318ccd835f837802bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:16.752116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:16.752626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:16.755439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:16.760791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 900/1825] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:16 2022] DELETE /identity/v3/projects/46bb1f5e185e4c318ccd835f837802bd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:16.762010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:16.763462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:16.789581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d1fd7-95fb-464c-9cbb-5f4e25526fff None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:16.858164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:16.946976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:16.947695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:16.947980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:16.948388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] PATH_INFO: `/v3/projects/3048c7dc1b634cadbd72a6f1ddd4f6f8` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:16.950915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3048c7dc1b634cadbd72a6f1ddd4f6f8)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:16.964458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:16.966952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b715ea-c8b4-4d0f-ac35-b7e5ba3e095a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:16.980144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:16.980144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:16.981292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:16.982284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] PATH_INFO: `/v3/users/f99ba25441ac4464b4ebc98428f53a3e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:16.987864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99ba25441ac4464b4ebc98428f53a3e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:16.991865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:17.087058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:17.096672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99ba25441ac4464b4ebc98428f53a3e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.097605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99ba25441ac4464b4ebc98428f53a3e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.098919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99ba25441ac4464b4ebc98428f53a3e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.117002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99ba25441ac4464b4ebc98428f53a3e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.134516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99ba25441ac4464b4ebc98428f53a3e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.180181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 901/1826] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:16 2022] DELETE /identity/v3/users/f99ba25441ac4464b4ebc98428f53a3e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:17.181060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:17.183006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:17.195357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3048c7dc1b634cadbd72a6f1ddd4f6f8', 'request_id': 'req-b249c064-15c3-4d77-9f05-b5f44f562252'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.219911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3048c7dc1b634cadbd72a6f1ddd4f6f8', 'request_id': 'req-b249c064-15c3-4d77-9f05-b5f44f562252'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.226945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3048c7dc1b634cadbd72a6f1ddd4f6f8', 'request_id': 'req-b249c064-15c3-4d77-9f05-b5f44f562252'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.253771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] The token cache is being invalidate because project 3048c7dc1b634cadbd72a6f1ddd4f6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:17.254065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.263764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.265596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 926/1827] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:16 2022] DELETE /identity/v3/projects/3048c7dc1b634cadbd72a6f1ddd4f6f8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:17.266316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:17.267713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:17.360384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db7c6-b38d-4c88-8d89-5cec51fc2fbf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:17.381320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:17.382491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.382939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.383506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:17.389805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:17.402546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c064-15c3-4d77-9f05-b5f44f562252 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:17.416114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:17.431502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:17.452241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 902/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:17.453200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:17.454613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:17.584854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:17.601439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:17.602094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.602368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.602738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] PATH_INFO: `/v3/projects/e4581b33f95c4348b273f7d3f6c8b012` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:17.612137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4581b33f95c4348b273f7d3f6c8b012)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:17.614051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:17.651513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08465bd-7f4f-4233-8417-0f7fcb8fcd00 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:17.672294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:17.673067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.673435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.673826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] PATH_INFO: `/v3/users/fa3a5f80509242b4b858e3d03c1a7b8a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:17.676864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3a5f80509242b4b858e3d03c1a7b8a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:17.682604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:17.722786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4581b33f95c4348b273f7d3f6c8b012', 'request_id': 'req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.728986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4581b33f95c4348b273f7d3f6c8b012', 'request_id': 'req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.742894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4581b33f95c4348b273f7d3f6c8b012', 'request_id': 'req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.768185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] The token cache is being invalidate because project e4581b33f95c4348b273f7d3f6c8b012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:17.768570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.770566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-14da9e4c-e17b-4f01-bbd4-c8e786db29e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.776885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 927/1829] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:17 2022] DELETE /identity/v3/projects/e4581b33f95c4348b273f7d3f6c8b012 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:17.787103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f53c9-e1fb-43b7-a5f5-333911fad252 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.788527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f53c9-e1fb-43b7-a5f5-333911fad252 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.788831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f53c9-e1fb-43b7-a5f5-333911fad252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:17.801487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3a5f80509242b4b858e3d03c1a7b8a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.802302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3a5f80509242b4b858e3d03c1a7b8a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.803107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3a5f80509242b4b858e3d03c1a7b8a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.807359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:17.815779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3a5f80509242b4b858e3d03c1a7b8a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.829207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-187905fa-8bae-4100-bb1c-0886bb3d5b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3a5f80509242b4b858e3d03c1a7b8a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:17.832310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-338f53c9-e1fb-43b7-a5f5-333911fad252 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:17.833522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-338f53c9-e1fb-43b7-a5f5-333911fad252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:17.862939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 903/1830] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:17 2022] DELETE /identity/v3/users/fa3a5f80509242b4b858e3d03c1a7b8a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:17.918968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25ee7d-f37c-4eab-a71b-eb2205e8935b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.920004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25ee7d-f37c-4eab-a71b-eb2205e8935b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.921093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25ee7d-f37c-4eab-a71b-eb2205e8935b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:17.925147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 904/1831] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:16:17 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:16:17.929547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 928/1832] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:17.939586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.940715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.941152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:17.966852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:17.967317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:17.967674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.040814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:18.044592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:18.050672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.055211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.269674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 929/1833] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:16:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:18.271187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:18.272966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.274215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 905/1834] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:18.279001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:18.291306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c7e3-f4ff-4895-a497-a89971dcc59a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:18.299463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:18.299763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7bfd4-0ac6-4f54-922f-93d999c8a532 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:18.301052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:18.301545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:18.302172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.303799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:18.304411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:18.306744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:18.316440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:18.317194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:18.317619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:18.318934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] PATH_INFO: `/v3/projects/829faccb620448cb9176560936525ae0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.322063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829faccb620448cb9176560936525ae0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:18.324723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:18.326116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 906/1835] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:18.331058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:18.352670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:18.359273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6c0e-d5f6-41ff-9726-a14e2e7a4684 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:18.370666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:18.373257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:18.373703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:18.374074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.375217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:18.379224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:18.428461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 907/1836] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:18 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:18.429568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:18.432194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.488259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829faccb620448cb9176560936525ae0', 'request_id': 'req-6d2616c0-be37-445b-b84e-177131aed978'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:18.513989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829faccb620448cb9176560936525ae0', 'request_id': 'req-6d2616c0-be37-445b-b84e-177131aed978'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:18.528883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829faccb620448cb9176560936525ae0', 'request_id': 'req-6d2616c0-be37-445b-b84e-177131aed978'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:18.553346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] The token cache is being invalidate because project 829faccb620448cb9176560936525ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:18.553807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:18.554962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:18.557422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 930/1837] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:18 2022] DELETE /identity/v3/projects/829faccb620448cb9176560936525ae0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:18.561330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:18.564103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.586454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61034f23-2177-4436-b9cb-582efb497ff3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:18.595799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:18.596906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:18.597295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:18.598659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.601366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.638621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:18.642880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:18.671197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 908/1838] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:18.676567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:18.678710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:18.735701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:18.757950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2616c0-be37-445b-b84e-177131aed978 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:18.874627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b2838-8d3f-42c3-b5d5-b8d83d86aa46 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:18.886684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:18.887532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:18.887908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:18.888353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.889453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:18.892117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:18.897518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:18.900987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:18.900987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:18.901218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] PATH_INFO: `/v3/users/e26c7405231a45809817ca3b008a4df9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:18.904166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26c7405231a45809817ca3b008a4df9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:18.908447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:18.950848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 931/1839] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:18 2022] POST /identity/v3/users => generated 301 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:18.952200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:19.003528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26c7405231a45809817ca3b008a4df9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.004155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d406-ae0b-4137-af2e-db8db315da15 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:19.005178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26c7405231a45809817ca3b008a4df9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.009551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26c7405231a45809817ca3b008a4df9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.021224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:19.023487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.023780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.024056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.024402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26c7405231a45809817ca3b008a4df9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.024814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:19.026796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:19.035274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26c7405231a45809817ca3b008a4df9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.041815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 932/1840] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:19.056231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:19.061300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:19.071018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 909/1841] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:18 2022] DELETE /identity/v3/users/e26c7405231a45809817ca3b008a4df9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:19.087941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:19.095044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:19.139955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe37ce8-19f7-43e0-a196-754abb047b24 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:19.210290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:19.309637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:19.310956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.314977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.314977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.315520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:19.322226 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:19.328479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d6e1a-feb1-4ceb-8148-b279f4e61b9c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:19.340640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:19.345783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.346422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.350620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 933/1842] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:19.352598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:19.354414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] PATH_INFO: `/v3/users/dc511a972861484688ed8c2a3fa87548` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.356903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:19.362053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc511a972861484688ed8c2a3fa87548)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:19.370346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:19.392875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05322e-6a5f-4572-9f67-834841ba1b24 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:19.407548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:19.408146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.408442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.408698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] PATH_INFO: `/v3/projects/b6572b36db604a13b4f030a62eeb0488` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.411065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6572b36db604a13b4f030a62eeb0488)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:19.413927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:19.514300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6572b36db604a13b4f030a62eeb0488', 'request_id': 'req-8599378a-7e2d-4269-bd55-9ff93a903381'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.520566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:19.524387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6572b36db604a13b4f030a62eeb0488', 'request_id': 'req-8599378a-7e2d-4269-bd55-9ff93a903381'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.534223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6572b36db604a13b4f030a62eeb0488', 'request_id': 'req-8599378a-7e2d-4269-bd55-9ff93a903381'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.547769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc511a972861484688ed8c2a3fa87548'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.550444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc511a972861484688ed8c2a3fa87548'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.551949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc511a972861484688ed8c2a3fa87548'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.559991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] The token cache is being invalidate because project b6572b36db604a13b4f030a62eeb0488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:19.560658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.562097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.565004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 934/1843] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:19 2022] DELETE /identity/v3/projects/b6572b36db604a13b4f030a62eeb0488 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:19.568465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:19.571922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:19.577570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc511a972861484688ed8c2a3fa87548'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.607592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fc7485d-b026-4327-b5d2-e89d81dbdf7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc511a972861484688ed8c2a3fa87548'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:19.677787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 910/1844] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:19 2022] DELETE /identity/v3/users/dc511a972861484688ed8c2a3fa87548 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:19.677787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5705-c5b8-4e2c-8c7b-2988fd48a800 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.678365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5705-c5b8-4e2c-8c7b-2988fd48a800 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.680722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5705-c5b8-4e2c-8c7b-2988fd48a800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.738714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-13ac5705-c5b8-4e2c-8c7b-2988fd48a800 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:19.740008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-13ac5705-c5b8-4e2c-8c7b-2988fd48a800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:19.759733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599378a-7e2d-4269-bd55-9ff93a903381 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:19.856051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:19.876416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecaf1-5bef-429b-a1b5-b4e9af91295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:19.878450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecaf1-5bef-429b-a1b5-b4e9af91295e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.879723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecaf1-5bef-429b-a1b5-b4e9af91295e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.880384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecaf1-5bef-429b-a1b5-b4e9af91295e admin admin] PATH_INFO: `/v3/projects/6e96cfb338554fe887731be35ac1da87/users/b934af85a21b4e27aff58924e183194c/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.937803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecaf1-5bef-429b-a1b5-b4e9af91295e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e96cfb338554fe887731be35ac1da87, user_id=b934af85a21b4e27aff58924e183194c, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:19.938823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 911/1845] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:19.940639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecaf1-5bef-429b-a1b5-b4e9af91295e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:19.941984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6781522-baaa-4d41-9b72-121054af539e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.942434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6781522-baaa-4d41-9b72-121054af539e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.942869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6781522-baaa-4d41-9b72-121054af539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.967056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 935/1846] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:19 2022] PUT /identity/v3/projects/6e96cfb338554fe887731be35ac1da87/users/b934af85a21b4e27aff58924e183194c/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:19.977941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:19.978346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:19.978483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:19.979942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a6781522-baaa-4d41-9b72-121054af539e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:19.984420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a6781522-baaa-4d41-9b72-121054af539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.037709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] MFA Rules not processed for user `b934af85a21b4e27aff58924e183194c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:20.039146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.129243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 912/1847] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:20.130493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6781522-baaa-4d41-9b72-121054af539e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.148072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6781522-baaa-4d41-9b72-121054af539e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.167677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.167677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.168066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.171572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.172404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:20.172657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.178977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.194752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 936/1848] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:19 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:20.195777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.204464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 913/1849] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:16:20.207849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.211844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3913-2b11-40ac-b786-f0a76aa664f0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.219354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.220410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.220816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.221094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.221777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.223954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.230599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a3f-81cf-4b8a-b7d4-a16f1ddf0b00 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.240490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.241453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.241944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.242526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.243543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.247507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.284989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 937/1850] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:20 2022] POST /identity/v3/projects => generated 401 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:20.289455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.339211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 914/1851] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:20 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:20.339211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.401530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:20.463448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9e81c-0a6f-4e31-82bb-e2e18cfd8a56 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.492882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c246ed-5029-40ed-ae74-ff75cfc1af70 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.510623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.511288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.512271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.512518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.513224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.515184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.565221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 915/1852] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:20 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:20.565221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.570767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.575435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:20.589722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.590407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.590954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.591328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.592148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.595756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.600096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cb3a-9b8f-4734-bcf0-e59b40e6066c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.609685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.611089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.611733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.612487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] PATH_INFO: `/v3/projects/56923d26c2a64abfaf80397822b44425` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.617795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=56923d26c2a64abfaf80397822b44425)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.621584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.629286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 938/1853] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:20 2022] POST /identity/v3/users => generated 307 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:20.632289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.651536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6493-dea6-4cd9-8502-89ffebca3dd8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.658154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.658788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.659108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.659422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.660121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.661946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.677249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 939/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:20.678551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.692941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1212-df63-4476-845f-322c4578da8e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.702388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.705143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.705143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.705143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.705143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.707407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.720364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 940/1855] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:20.721366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.726700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.740479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56923d26c2a64abfaf80397822b44425', 'request_id': 'req-1a044623-0b66-45eb-af2b-55937f6110ea'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.752069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37a618-af03-4302-90b3-eaf630866b39 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.755799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56923d26c2a64abfaf80397822b44425', 'request_id': 'req-1a044623-0b66-45eb-af2b-55937f6110ea'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.766909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56923d26c2a64abfaf80397822b44425', 'request_id': 'req-1a044623-0b66-45eb-af2b-55937f6110ea'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.784861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] The token cache is being invalidate because project 56923d26c2a64abfaf80397822b44425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:20.785632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.785994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.787811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 916/1856] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:20 2022] DELETE /identity/v3/projects/56923d26c2a64abfaf80397822b44425 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:20.788732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.790187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.829747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.830496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.830676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.830947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] PATH_INFO: `/v3/projects/4f8f1267349848809432c21275879d5e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.832939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8f1267349848809432c21275879d5e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.834858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.870108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044623-0b66-45eb-af2b-55937f6110ea admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.877155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.877999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.878291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.878677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:20.879578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:20.881193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:20.894603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 917/1857] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:20.894774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8f1267349848809432c21275879d5e', 'request_id': 'req-49d6524a-11c9-47c8-9916-aec0a843a56b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.896567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.900514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.901298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8f1267349848809432c21275879d5e', 'request_id': 'req-49d6524a-11c9-47c8-9916-aec0a843a56b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.909202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8f1267349848809432c21275879d5e', 'request_id': 'req-49d6524a-11c9-47c8-9916-aec0a843a56b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.921884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec122c3-427a-4736-9500-03bee960bbf8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:20.925663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] The token cache is being invalidate because project 4f8f1267349848809432c21275879d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:20.926110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.927033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:20.929951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 941/1858] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:20 2022] DELETE /identity/v3/projects/4f8f1267349848809432c21275879d5e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:20.930960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:20.932676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:20.960925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:20.994861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807742-dbaa-426d-bc32-924d3abd360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:20.995581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807742-dbaa-426d-bc32-924d3abd360d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:20.996501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807742-dbaa-426d-bc32-924d3abd360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:20.996783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807742-dbaa-426d-bc32-924d3abd360d admin admin] PATH_INFO: `/v3/projects/d3a6dfe8e278449799c3afdedbf0b586/users/d04b93adaa3b42c48949f61fdb637059/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.002492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:21.015055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807742-dbaa-426d-bc32-924d3abd360d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a6dfe8e278449799c3afdedbf0b586, user_id=d04b93adaa3b42c48949f61fdb637059, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.018210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807742-dbaa-426d-bc32-924d3abd360d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.019128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6524a-11c9-47c8-9916-aec0a843a56b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.025628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.026365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.026699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.027803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] PATH_INFO: `/v3/projects/226ec2ccdc08456498fda3ae77484398` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.029274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226ec2ccdc08456498fda3ae77484398)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.031312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.035132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 918/1859] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:20 2022] PUT /identity/v3/projects/d3a6dfe8e278449799c3afdedbf0b586/users/d04b93adaa3b42c48949f61fdb637059/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:21.036445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285009e1-ada2-4904-afac-b7dad978d7c6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.036742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285009e1-ada2-4904-afac-b7dad978d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.037009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285009e1-ada2-4904-afac-b7dad978d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.059441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-285009e1-ada2-4904-afac-b7dad978d7c6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:21.060993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-285009e1-ada2-4904-afac-b7dad978d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.089062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226ec2ccdc08456498fda3ae77484398', 'request_id': 'req-2362dff6-182d-4d1c-a328-e5b8b4591fc4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.095196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226ec2ccdc08456498fda3ae77484398', 'request_id': 'req-2362dff6-182d-4d1c-a328-e5b8b4591fc4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.102300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226ec2ccdc08456498fda3ae77484398', 'request_id': 'req-2362dff6-182d-4d1c-a328-e5b8b4591fc4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.117179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] The token cache is being invalidate because project 226ec2ccdc08456498fda3ae77484398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:21.117467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.118159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.119802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 942/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:20 2022] DELETE /identity/v3/projects/226ec2ccdc08456498fda3ae77484398 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:21.123117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.124056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.137121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 919/1861] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:21.138285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.138718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.138855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.160995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:21.162189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.202387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362dff6-182d-4d1c-a328-e5b8b4591fc4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.207916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.208675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.209145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.209520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] PATH_INFO: `/v3/projects/2aed0be1148f4c629e56b0a56405402f/users/f63c8affea6f44c6b935e0e94d01e1eb/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.226207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aed0be1148f4c629e56b0a56405402f, user_id=f63c8affea6f44c6b935e0e94d01e1eb, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.229165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.237942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 920/1862] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:21.244104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.244104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.250231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 943/1863] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:21 2022] PUT /identity/v3/projects/2aed0be1148f4c629e56b0a56405402f/users/f63c8affea6f44c6b935e0e94d01e1eb/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:21.251050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.251990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253d701-f208-42d8-9d3c-6dc96d8fc3ae None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.252785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.305683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:21.313483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f90f-09fb-4976-b25e-6e250ee3cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.314098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f90f-09fb-4976-b25e-6e250ee3cac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.314376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f90f-09fb-4976-b25e-6e250ee3cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.314648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f90f-09fb-4976-b25e-6e250ee3cac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.315354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f90f-09fb-4976-b25e-6e250ee3cac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.316979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f90f-09fb-4976-b25e-6e250ee3cac1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.318289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da697fe-c088-4f44-8fde-5167d1c8a5f2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.331096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 921/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:21.331389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.331389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.331389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.331634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7225fd-4637-424e-96b0-2374eb655bec None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.331634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7225fd-4637-424e-96b0-2374eb655bec None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.331634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7225fd-4637-424e-96b0-2374eb655bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.331842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] PATH_INFO: `/v3/users/4cba23a3ce674ba7a734c613e76d6427` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.332826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cba23a3ce674ba7a734c613e76d6427)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.334711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.343048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:21.369788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0e7225fd-4637-424e-96b0-2374eb655bec None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:21.371391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0e7225fd-4637-424e-96b0-2374eb655bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.384331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 922/1865] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:21.385489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda986-7ca6-474a-bad7-f7c1cb11b8a3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.385771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda986-7ca6-474a-bad7-f7c1cb11b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.389074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda986-7ca6-474a-bad7-f7c1cb11b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.403470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cba23a3ce674ba7a734c613e76d6427'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.404369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cba23a3ce674ba7a734c613e76d6427'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.405162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cba23a3ce674ba7a734c613e76d6427'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.410651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-03cda986-7ca6-474a-bad7-f7c1cb11b8a3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:21.412056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-03cda986-7ca6-474a-bad7-f7c1cb11b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.420400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cba23a3ce674ba7a734c613e76d6427'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.420919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 923/1866] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:21.422227 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.422510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.422780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.433585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cba23a3ce674ba7a734c613e76d6427'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.455588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] MFA Rules not processed for user `f63c8affea6f44c6b935e0e94d01e1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:21.455811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 944/1867] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:21 2022] DELETE /identity/v3/users/4cba23a3ce674ba7a734c613e76d6427 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:21.455811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.455997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.465436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.545306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 924/1868] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:21.546415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.551505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.576921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c651ba-89b9-4300-94fe-1c48a4e42a38 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.581162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.581881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.582164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.582443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] PATH_INFO: `/v3/projects/d3a6dfe8e278449799c3afdedbf0b586/users/d04b93adaa3b42c48949f61fdb637059/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.584407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a6dfe8e278449799c3afdedbf0b586, user_id=d04b93adaa3b42c48949f61fdb637059, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.587451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.598736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 945/1869] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:21 2022] PUT /identity/v3/projects/d3a6dfe8e278449799c3afdedbf0b586/users/d04b93adaa3b42c48949f61fdb637059/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:21.609179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.654412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8470e8a-cc5b-45d7-b845-f1e929ffcf7b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.666694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c1130-f47d-433d-968c-358d099fef12 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.674602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.677560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.677560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.677560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.677560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:21.677560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.678987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.692898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 946/1870] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:21.694308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.697470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.712328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6b22f-1c17-4294-ae4e-0f1d0db3478b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.720228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.721084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.721366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.721643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.722297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.724363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.733357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.734046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.734392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.734670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.735085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:21.735408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:21.735705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.737300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a19960-c196-4099-a5b8-b877f9758863 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.753954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 925/1871] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:21.755379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.755711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.755826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 947/1872] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:21.755983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.756586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.758134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.777410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:21.789396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] MFA Rules not processed for user `d04b93adaa3b42c48949f61fdb637059`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:21.790897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:21.838600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c645187-2204-4d38-bc85-7240d609c230 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.843936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.844623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.844967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.845230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] PATH_INFO: `/v3/projects/3d43b44ccaf444ceb5ca169c31f59bd1` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.846373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d43b44ccaf444ceb5ca169c31f59bd1)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.848463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.872860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 926/1873] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:21.876049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.890944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1a18-c08d-46d1-a597-07f19171da50 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:21.895342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:21.895985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:21.896271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:21.896547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:21.897212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:21.899116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:21.907759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d43b44ccaf444ceb5ca169c31f59bd1', 'request_id': 'req-139295e2-aba5-49cf-a028-c7ba916ad763'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.914039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d43b44ccaf444ceb5ca169c31f59bd1', 'request_id': 'req-139295e2-aba5-49cf-a028-c7ba916ad763'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.921410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d43b44ccaf444ceb5ca169c31f59bd1', 'request_id': 'req-139295e2-aba5-49cf-a028-c7ba916ad763'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.940727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 927/1874] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:21.940727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.940987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] The token cache is being invalidate because project 3d43b44ccaf444ceb5ca169c31f59bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:21.940987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.940987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:21.940987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 948/1875] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:21 2022] DELETE /identity/v3/projects/3d43b44ccaf444ceb5ca169c31f59bd1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:21.940987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:21.943449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.002625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13874b6-51ae-4621-9354-ec2b2bbfb2d6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.006341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139295e2-aba5-49cf-a028-c7ba916ad763 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.007838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.008571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.008885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.009157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.009808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.011015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.011680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.011799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.011955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.012222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.012873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.014768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.035655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 949/1876] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:22.036788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.038605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.042131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 928/1877] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:21 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:22.042131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.044126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.052010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:22.099829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220634c4-1790-4194-8d9e-65bb9300a6f8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.103484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:22.107982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddc95a-578d-487a-8ab4-815f4b48a52c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.113699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298717a3-c79d-4bab-9f23-a5aa3576858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.114316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298717a3-c79d-4bab-9f23-a5aa3576858d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.114598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298717a3-c79d-4bab-9f23-a5aa3576858d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.114871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298717a3-c79d-4bab-9f23-a5aa3576858d admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.115634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298717a3-c79d-4bab-9f23-a5aa3576858d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.117697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298717a3-c79d-4bab-9f23-a5aa3576858d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.139834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 929/1878] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:22.141107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.141395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.141674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.154637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.155276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.155599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.155823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.157589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.162018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:22.167197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.171673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 930/1879] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:22.172434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.184933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768cc47-b593-473b-a94a-3fe1ed05eff9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.190260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.191311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.191603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.191881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.192568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.194903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.205358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 931/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:22.206138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.207780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.220562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cbf0-7aca-4773-a59b-eea562464e2e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.225096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c689a06-e7c6-42bb-9145-fecbd1b4af5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.225684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c689a06-e7c6-42bb-9145-fecbd1b4af5a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.225969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c689a06-e7c6-42bb-9145-fecbd1b4af5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.226244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c689a06-e7c6-42bb-9145-fecbd1b4af5a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.226886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c689a06-e7c6-42bb-9145-fecbd1b4af5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.228814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c689a06-e7c6-42bb-9145-fecbd1b4af5a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.229179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.230857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.240381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 950/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:22.241193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.251825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb592f-17d5-44f8-aa89-fb68e27795c2 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.255755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 932/1882] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/users => generated 294 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:22.255755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.255755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.255755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.256740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.257375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.257663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.257938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.258633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.260510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.272187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 951/1883] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:22.273244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.279447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:22.280771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.289790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 933/1884] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:22.290139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b129e0-0c1d-4a7c-8b36-99d3a9ff31b7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.293527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.296108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.296731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.297068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.297355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.298513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.300534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.304366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f4b2-c22b-43bb-aa73-7245b4f9f218 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.310009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.310756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.311131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.311542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.312328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.323306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 952/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:22.323588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.323693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.328545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 934/1886] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:22.328545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.328881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef048c-61a1-4890-8121-b79a20e872f5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.332147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.332935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.333218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.333510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.334178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.335788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.336628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7393a17-ec60-435f-8e53-af7446afcc6a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.341337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.341928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.342203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.342478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.343172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:22.343477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.345036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.347638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 953/1887] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:22.348402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.358547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 935/1888] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:22.358701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b240ed-5027-41c6-8377-4fdeb2b5b430 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.359720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.366002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.366657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.366936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.367240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] PATH_INFO: `/v3/projects/625feccb341c4b039f0db0644340bb9f/users/c9f0af24aa8046fc8ca3c28123d39428/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.369441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7e361-cf65-484a-9e0d-6ab766609d11 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.374254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.374839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.375137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.375433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.376103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.377678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.382452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625feccb341c4b039f0db0644340bb9f, user_id=c9f0af24aa8046fc8ca3c28123d39428, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.385121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.388241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 936/1889] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:22.391714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.399943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 954/1890] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:22 2022] PUT /identity/v3/projects/625feccb341c4b039f0db0644340bb9f/users/c9f0af24aa8046fc8ca3c28123d39428/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:22.410310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5a28a-cb13-4d1e-a4d7-3aee7b9e8aae admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.410432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.421777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:22.463746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.464628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.464920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.465269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.467106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.471505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b20e-2a4c-4353-a2c3-547b7342bd47 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.477158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.478002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.478762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.479110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] PATH_INFO: `/v3/projects/f6c161e2057f423d8afe3fe6fd054c89/users/760e2a28b0de459c901592665db17d6a/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.498204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c161e2057f423d8afe3fe6fd054c89, user_id=760e2a28b0de459c901592665db17d6a, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.501081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.519725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 955/1891] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:22 2022] PUT /identity/v3/projects/f6c161e2057f423d8afe3fe6fd054c89/users/760e2a28b0de459c901592665db17d6a/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:22.521090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.547251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.549324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.559580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 937/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:22 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:22.560321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.571378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77e19f-49fc-4738-9d7e-1570dbbe00fd service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.605844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:22.619232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7584b0-65b2-4e15-8aa2-34753af5dc4c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.629521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601d119-dae4-4a58-ba10-7026b80a0cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.630202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d119-dae4-4a58-ba10-7026b80a0cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.630483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d119-dae4-4a58-ba10-7026b80a0cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.630905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d119-dae4-4a58-ba10-7026b80a0cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.631671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601d119-dae4-4a58-ba10-7026b80a0cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.635096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601d119-dae4-4a58-ba10-7026b80a0cfe admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.672892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aedd1-b71d-4d37-a45a-7069383df19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.673812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aedd1-b71d-4d37-a45a-7069383df19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.675085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aedd1-b71d-4d37-a45a-7069383df19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.675727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aedd1-b71d-4d37-a45a-7069383df19a admin admin] PATH_INFO: `/v3/projects/8e4793c93e4c49b89df53f12c13b7053/users/6582e4fd5e1146b5a753f62cd6b28453/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.688842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 956/1893] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:22.688842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.688842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.688842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.701137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aedd1-b71d-4d37-a45a-7069383df19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4793c93e4c49b89df53f12c13b7053, user_id=6582e4fd5e1146b5a753f62cd6b28453, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.704415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aedd1-b71d-4d37-a45a-7069383df19a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:22.725129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 938/1894] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:22 2022] PUT /identity/v3/projects/8e4793c93e4c49b89df53f12c13b7053/users/6582e4fd5e1146b5a753f62cd6b28453/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:22.726367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337f099-6e03-4d0b-8c83-17efaebbf6e1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.726667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337f099-6e03-4d0b-8c83-17efaebbf6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.726943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337f099-6e03-4d0b-8c83-17efaebbf6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.727556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] MFA Rules not processed for user `c9f0af24aa8046fc8ca3c28123d39428`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:22.729161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.766581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1337f099-6e03-4d0b-8c83-17efaebbf6e1 None None] MFA Rules not processed for user `760e2a28b0de459c901592665db17d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:22.767845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1337f099-6e03-4d0b-8c83-17efaebbf6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.845674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 957/1895] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:22.849512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:22.869331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 939/1896] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:22.870844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.872060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.872384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.883947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:22.908295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] MFA Rules not processed for user `6582e4fd5e1146b5a753f62cd6b28453`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:22.909518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:22.939974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ee0a-e586-447f-95c7-5cc8b11d0143 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:22.946967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:22.948883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:22.948883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:22.948883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:22.959814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:22.961935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.008761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 958/1897] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.009663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.023764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b172a-1479-4584-a6a7-c3724c8a7292 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.025868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 940/1898] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:23.027479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.046235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.046564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae597-8fef-42e0-946a-adb765680172 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.047031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.047970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.050726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.051530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.052849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.054392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.054728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.055062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.055959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.057965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.068099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.096564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 941/1899] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.097613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.103409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:23.109487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 959/1900] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.110623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.188581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14122a-1431-4a71-8293-b66d9ebad425 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.201499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688acde3-7e30-4834-a698-f8ff6ac3dc5a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.202085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.202739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.203016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.203326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.203990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.205925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.206645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.207462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.207818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.208161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.208860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.210474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.223371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 942/1901] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.224538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.237159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 960/1902] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.237506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fe282-df26-42ac-8b58-453f77bc8528 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.237971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.299549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.300290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.300591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.300858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.301524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.303457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.304742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06669-4888-42c0-b170-953214109a39 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.311824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.312743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.313124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.313931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.314976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.317153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.331123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 943/1903] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.332086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.334919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:23.341953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 961/1904] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.342894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6eb13-81a6-4704-afa7-65bdffc4e1db admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.343009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.347504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.348111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.348394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.348666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.349352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.350937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.353184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49333af-77cc-498c-baf0-299b66fa6dd7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.357904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.358503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.358785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.359060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.359756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.361743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 944/1905] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.361848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.362396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.373146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a987d22-f5b5-42f3-bc84-93d8903191cb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.378496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.379322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.379611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.379979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.380747 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.382473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.387716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 962/1906] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.387716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.397136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 945/1907] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.397136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.397359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a10e4-187b-44eb-887c-3b302fe3af7e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.400067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.400663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.401061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.401363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.402114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.403731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.405200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202659b-b80b-483a-87c1-4f421cc900a9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.409887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.410570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.410861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.411138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] PATH_INFO: `/v3/projects/cdbf4c5fbd304f50a8f720889f972fab/users/f76216ca0efd497fbd5f8a97b9c5dc47/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.414464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 963/1908] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.415280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.425112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af625767-f063-4051-9d5f-81979e4e9de8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.426631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbf4c5fbd304f50a8f720889f972fab, user_id=f76216ca0efd497fbd5f8a97b9c5dc47, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.429847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.429995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.430430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.430706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.430973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.431680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.433968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.444726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 964/1909] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.445258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 946/1910] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:23 2022] PUT /identity/v3/projects/cdbf4c5fbd304f50a8f720889f972fab/users/f76216ca0efd497fbd5f8a97b9c5dc47/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:23.446169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.447968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.468240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b752bf-fb7c-4259-aa73-5c99afaba828 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.511927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:23.534805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2035-4368-4b25-8ee3-c219c495426e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.535378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.536129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.536412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.536689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] PATH_INFO: `/v3/projects/32221d3384e44f5b9fe25b78c2e0f2f8/users/d5fa09f128634b909d3b9cbb3ec27402/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.548612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97af84-a649-4670-9d59-8794477e337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.549593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97af84-a649-4670-9d59-8794477e337f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.550016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97af84-a649-4670-9d59-8794477e337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.550450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97af84-a649-4670-9d59-8794477e337f admin admin] PATH_INFO: `/v3/projects/daecba3963814602a9e8e7364d9ab27f/users/61c31523d1054be9a9061e06f1604a4b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.564438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32221d3384e44f5b9fe25b78c2e0f2f8, user_id=d5fa09f128634b909d3b9cbb3ec27402, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.568471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.569307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97af84-a649-4670-9d59-8794477e337f admin admin] RBAC: Authorizing `identity:create_grant(project_id=daecba3963814602a9e8e7364d9ab27f, user_id=61c31523d1054be9a9061e06f1604a4b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.572471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97af84-a649-4670-9d59-8794477e337f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.590217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 965/1911] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:23 2022] PUT /identity/v3/projects/32221d3384e44f5b9fe25b78c2e0f2f8/users/d5fa09f128634b909d3b9cbb3ec27402/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:23.591912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.594122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 947/1912] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:23 2022] PUT /identity/v3/projects/daecba3963814602a9e8e7364d9ab27f/users/61c31523d1054be9a9061e06f1604a4b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:23.595547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.596380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.596652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.630898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] MFA Rules not processed for user `f76216ca0efd497fbd5f8a97b9c5dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:23.632163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:23.670804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f746c-390f-491a-b5ae-a536cee7dca3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.727485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:23.734101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 948/1913] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:23.735080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.753105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.753770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.754324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.754601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.755344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.757761 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.772146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 966/1914] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.776299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.789024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380661-a11c-4a23-b80f-632263bfaa3e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.795322 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.795972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.796257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.796529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.797223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.798838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.809475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 967/1915] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.810262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.819290 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98a12e-f81c-46dd-b1ab-271379e16fbc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.820007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7530a-e40c-4953-b3ba-e7264c102684 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.825645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.826261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.826521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.826631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.826804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.827308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.827510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.827696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.828051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.828810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.829431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.830530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.846261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 949/1916] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:23.846261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.857257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c7fae-8e2e-4ba5-b38a-1ebec0cc3302 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:23.864902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:23.865766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:23.866053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:23.866435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] PATH_INFO: `/v3/projects/80cfe3c61c5e4375aadea737c79ee04a/users/30bde845bd5d4fe994745f3570206b79/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:23.869317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 968/1917] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:23.871739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.936144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cfe3c61c5e4375aadea737c79ee04a, user_id=30bde845bd5d4fe994745f3570206b79, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:23.938850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:23.974531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 950/1918] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:23 2022] PUT /identity/v3/projects/80cfe3c61c5e4375aadea737c79ee04a/users/30bde845bd5d4fe994745f3570206b79/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:23.975307 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:23.985695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6de6-28dd-46d0-8383-c1fc8ff363a7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.043562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:24.094063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.094818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.095105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.095406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] PATH_INFO: `/v3/projects/daecba3963814602a9e8e7364d9ab27f/users/61c31523d1054be9a9061e06f1604a4b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.100076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daecba3963814602a9e8e7364d9ab27f, user_id=61c31523d1054be9a9061e06f1604a4b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:24.102958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:24.137859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 969/1919] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:23 2022] PUT /identity/v3/projects/daecba3963814602a9e8e7364d9ab27f/users/61c31523d1054be9a9061e06f1604a4b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:24.138872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:24.142303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ecc10-5865-47f6-83af-aa40a3ae5888 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.251830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:24.271336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f61bb-017e-49b2-9194-7bf4b48daf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.272137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f61bb-017e-49b2-9194-7bf4b48daf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.272794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f61bb-017e-49b2-9194-7bf4b48daf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.273445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f61bb-017e-49b2-9194-7bf4b48daf22 admin admin] PATH_INFO: `/v3/projects/32221d3384e44f5b9fe25b78c2e0f2f8/users/d5fa09f128634b909d3b9cbb3ec27402/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.276356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f61bb-017e-49b2-9194-7bf4b48daf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32221d3384e44f5b9fe25b78c2e0f2f8, user_id=d5fa09f128634b909d3b9cbb3ec27402, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:24.277648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b6eb-e459-48fc-838d-044c1626d744 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.280420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f61bb-017e-49b2-9194-7bf4b48daf22 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:24.288318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e89315-bbe9-4d54-8f84-3c8b641be5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.289129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89315-bbe9-4d54-8f84-3c8b641be5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.289414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89315-bbe9-4d54-8f84-3c8b641be5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.291462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89315-bbe9-4d54-8f84-3c8b641be5bd admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.293991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e89315-bbe9-4d54-8f84-3c8b641be5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:24.296027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e89315-bbe9-4d54-8f84-3c8b641be5bd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:24.305914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 951/1920] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:23 2022] PUT /identity/v3/projects/32221d3384e44f5b9fe25b78c2e0f2f8/users/d5fa09f128634b909d3b9cbb3ec27402/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:24.307820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899745-6673-46c6-baf3-cc6c8c87a130 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.308708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899745-6673-46c6-baf3-cc6c8c87a130 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.309091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899745-6673-46c6-baf3-cc6c8c87a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.348102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 970/1921] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:24 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:24.352547 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.352856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.353228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.373593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1a899745-6673-46c6-baf3-cc6c8c87a130 None None] MFA Rules not processed for user `30bde845bd5d4fe994745f3570206b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:24.374857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a899745-6673-46c6-baf3-cc6c8c87a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:24.426897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] MFA Rules not processed for user `61c31523d1054be9a9061e06f1604a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:24.428872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:24.588304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 952/1922] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:24.593113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db219-300d-493d-9994-964b57465bd1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.593430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db219-300d-493d-9994-964b57465bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.593717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78db219-300d-493d-9994-964b57465bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.630889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 971/1923] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:24.631911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:24.660784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a78db219-300d-493d-9994-964b57465bd1 None None] MFA Rules not processed for user `d5fa09f128634b909d3b9cbb3ec27402`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:24.662027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a78db219-300d-493d-9994-964b57465bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:24.747221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:24.765174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120bf55-e21d-49ef-9081-ff4bb42d810f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.771360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.772095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.772449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.772810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.774307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:24.776363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:24.794591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 953/1924] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:24.794591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db219-300d-493d-9994-964b57465bd1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:24.794875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 972/1925] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:24.795940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:24.817651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78db219-300d-493d-9994-964b57465bd1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.826089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.826850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.827261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.827631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.829422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:24.833045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:24.874479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58056d1-40ae-4de1-b927-240dcc042432 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.878951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.879619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.879903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.880179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.882040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 954/1926] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:24 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:24.883075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:24.894052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:24.895873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:24.906756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 973/1927] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:24.907550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:24.908863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:24.920370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd657-6350-40d6-a755-232b8eae9de9 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.924394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:24.981489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb61b3-28fa-4ebe-8235-d3cc6b784e65 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:24.984986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.985686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.985963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.986402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:24.990345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:24.991326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:24.991961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:24.992463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] PATH_INFO: `/v3/projects/b29aa56504204d879af0358b78b8b032/users/bcb9b25085f140ecb1b4ab19d0f7bfc9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.013955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29aa56504204d879af0358b78b8b032, user_id=bcb9b25085f140ecb1b4ab19d0f7bfc9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.017529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.036493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 955/1928] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:24 2022] PUT /identity/v3/projects/b29aa56504204d879af0358b78b8b032/users/bcb9b25085f140ecb1b4ab19d0f7bfc9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:25.037309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.066794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.068443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.080875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 974/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:25.082105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.092810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b85b-32f5-48e4-969f-3cfacc241afb service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.110565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b6df-641e-4180-8c41-642ae379a0bf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.126208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.126859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.127146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.127464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.128136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.130075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.152458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.153162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.153450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.153725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.158220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 956/1930] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:25 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:25.158357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:25.158470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.175474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b9024-25fa-4275-b1c7-81838bccb60a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.181357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.181981 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.182259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.182529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.183407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.185003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.195575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 957/1931] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:25.196429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.206778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4cdbf-5664-46b9-bc78-1ae0b9d04b0e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.211291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.211885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.212159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.212429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] PATH_INFO: `/v3/users/760e2a28b0de459c901592665db17d6a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.213548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=760e2a28b0de459c901592665db17d6a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.216216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.224920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.226600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.235682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 975/1932] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:25.236477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.237934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:25.249404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b36eb-e357-4a60-b638-02a462b0b680 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.255499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.256116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.256887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.256887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.257556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.259020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.265386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:25.271320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 976/1933] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:25.272342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.275555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760e2a28b0de459c901592665db17d6a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:25.276234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760e2a28b0de459c901592665db17d6a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:25.277059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760e2a28b0de459c901592665db17d6a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:25.283543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d814ac-58d1-4464-aaee-b08259c187a4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.288042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760e2a28b0de459c901592665db17d6a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:25.288855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.291698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.292000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.292334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] PATH_INFO: `/v3/projects/b29aa56504204d879af0358b78b8b032/users/bcb9b25085f140ecb1b4ab19d0f7bfc9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.296059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29aa56504204d879af0358b78b8b032, user_id=bcb9b25085f140ecb1b4ab19d0f7bfc9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.299223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.304081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-483a9e80-9ffb-4d7a-a735-8836eeb93c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760e2a28b0de459c901592665db17d6a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:25.316333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 977/1934] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:25 2022] PUT /identity/v3/projects/b29aa56504204d879af0358b78b8b032/users/bcb9b25085f140ecb1b4ab19d0f7bfc9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:25.317177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.325957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:25.345742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 958/1935] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:25 2022] DELETE /identity/v3/users/760e2a28b0de459c901592665db17d6a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:25.347105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093371-afd7-44ca-8a3b-13e1db0f1b9d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.347444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093371-afd7-44ca-8a3b-13e1db0f1b9d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.347775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093371-afd7-44ca-8a3b-13e1db0f1b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.381572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8a093371-afd7-44ca-8a3b-13e1db0f1b9d None None] MFA Rules not processed for user `bcb9b25085f140ecb1b4ab19d0f7bfc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:25.382018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a093371-afd7-44ca-8a3b-13e1db0f1b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:25.438595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5551-71e6-48da-9559-b5d9c781eba1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.519578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 959/1936] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:25.521093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.521392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.521644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.549512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:25.551268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:25.625805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 960/1937] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:25.626733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.628357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:25.666736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.667698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.667811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:25.667893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.668187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] PATH_INFO: `/v3/projects/5ecd894346ff4a9f8bb3f5e9a78acc1a/users/7b854dc37b764d35bbd599daf41ff62a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.687869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecd894346ff4a9f8bb3f5e9a78acc1a, user_id=7b854dc37b764d35bbd599daf41ff62a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.691078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.719625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 978/1938] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:25 2022] PUT /identity/v3/projects/5ecd894346ff4a9f8bb3f5e9a78acc1a/users/7b854dc37b764d35bbd599daf41ff62a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:25.719625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.729737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:25.752934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2c8d-4884-4734-aafb-bcefc89222d3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.844663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f9c4d-f4c9-4db1-bcfd-28205b60f584 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:25.847387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.848742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.849083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.849377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.854630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:25.856393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:25.864102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:25.864102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:25.930643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:25.967964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.970173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.987413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 961/1939] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:25.987413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:25.988590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:25.990107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:25.997046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b01ae-979e-4824-9089-0371bcc215e1 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:26.004673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:26.005560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 979/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:26.006518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:26.006988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:26.007512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:26.009189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:26.023672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:26.046141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 962/1941] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:26.047599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:26.059490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f3ef3-304d-4c94-ac96-78398be44785 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:26.064597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668c64-76a5-43fb-94cc-ac8465b25e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:26.065548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668c64-76a5-43fb-94cc-ac8465b25e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:26.065981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668c64-76a5-43fb-94cc-ac8465b25e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:26.066207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668c64-76a5-43fb-94cc-ac8465b25e9f admin admin] PATH_INFO: `/v3/projects/5ecd894346ff4a9f8bb3f5e9a78acc1a/users/7b854dc37b764d35bbd599daf41ff62a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:26.068434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91668c64-76a5-43fb-94cc-ac8465b25e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecd894346ff4a9f8bb3f5e9a78acc1a, user_id=7b854dc37b764d35bbd599daf41ff62a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:26.071604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91668c64-76a5-43fb-94cc-ac8465b25e9f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:26.084443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 980/1942] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:26 2022] PUT /identity/v3/projects/5ecd894346ff4a9f8bb3f5e9a78acc1a/users/7b854dc37b764d35bbd599daf41ff62a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:26.089957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:26.092094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:26.094160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:26.094623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:26.095182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:26.116102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310da0b-9c31-4697-8966-e73cf389551f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:26.137767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] MFA Rules not processed for user `7b854dc37b764d35bbd599daf41ff62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:26.139304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:26.200698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:26.202335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:26.202837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:26.203396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:26.206687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:26.254793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 981/1943] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:26.266113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:26.268897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:26.289373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b221d06-d263-437f-8794-8798fe5852f9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:26.297647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:26.298288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:26.298639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:26.299100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:26.307583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:26.310512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:26.316440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:26.318819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:26.323424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 963/1944] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:26.347062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 982/1945] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:26.570164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:26.571743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:26.765312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952c58-ab1a-4576-852f-04ca3d1f1e3f service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:26.773111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:26.773854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:26.774302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:26.774586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] PATH_INFO: `/v3/projects/f6c161e2057f423d8afe3fe6fd054c89` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:26.777864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c161e2057f423d8afe3fe6fd054c89)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:26.781372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:26.885485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c161e2057f423d8afe3fe6fd054c89', 'request_id': 'req-0203eeec-ee17-4d7b-9fff-621babcf5627'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:26.894229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c161e2057f423d8afe3fe6fd054c89', 'request_id': 'req-0203eeec-ee17-4d7b-9fff-621babcf5627'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:26.905061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c161e2057f423d8afe3fe6fd054c89', 'request_id': 'req-0203eeec-ee17-4d7b-9fff-621babcf5627'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:26.932439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] The token cache is being invalidate because project f6c161e2057f423d8afe3fe6fd054c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:26.934124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:26.935146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0203eeec-ee17-4d7b-9fff-621babcf5627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:26.939784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 964/1946] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:26 2022] DELETE /identity/v3/projects/f6c161e2057f423d8afe3fe6fd054c89 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:26.941514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:26.958349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883f231-2a21-4646-8e65-ddc4766272e7 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:27.073306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:27.074682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.075068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.075457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] PATH_INFO: `/v3/users/d5fa09f128634b909d3b9cbb3ec27402` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.076701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fa09f128634b909d3b9cbb3ec27402)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:27.078641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:27.108008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7f9a2-7fb8-436c-b39e-8db85a32134f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.108351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7f9a2-7fb8-436c-b39e-8db85a32134f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.108646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7f9a2-7fb8-436c-b39e-8db85a32134f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.110378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 965/1947] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:16:27.133772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:27.163600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.163917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.164202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.173172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fa09f128634b909d3b9cbb3ec27402'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.174801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fa09f128634b909d3b9cbb3ec27402'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.175637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fa09f128634b909d3b9cbb3ec27402'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.213766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:27.214861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:27.218013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fa09f128634b909d3b9cbb3ec27402'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.232942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fa09f128634b909d3b9cbb3ec27402'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.259202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 983/1948] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:26 2022] DELETE /identity/v3/users/d5fa09f128634b909d3b9cbb3ec27402 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:27.312645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:27.338148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 966/1949] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:16:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:27.368903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:27.371567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:27.498471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cd9f-21ff-49f4-9a2c-841b88b14608 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:27.513749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:27.514395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.514665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.514933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.539142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:27.544289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:27.567610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 984/1950] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:27.575029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:27.576462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:27.687990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b896b-2733-4a9c-84d0-458e43180c63 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:27.698056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:27.700917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:27.801746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:27.802754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.803488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.803995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.807691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:27.836436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56741f-e5f3-44bc-bd63-f4ac707b83ed service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:27.843455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:27.844495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.844903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.845970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] PATH_INFO: `/v3/users/b934af85a21b4e27aff58924e183194c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.847639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b934af85a21b4e27aff58924e183194c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:27.850585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:27.895283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:27.896191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:27.898042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:27.912162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 967/1951] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:27.915753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:27.918628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:27.928421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b934af85a21b4e27aff58924e183194c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.931027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b934af85a21b4e27aff58924e183194c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.932037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b934af85a21b4e27aff58924e183194c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.934708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d33c1-5ad7-43c6-8b21-9779b759a5d7 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:27.940497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:27.941146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:27.941596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:27.941914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] PATH_INFO: `/v3/projects/32221d3384e44f5b9fe25b78c2e0f2f8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:27.943101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32221d3384e44f5b9fe25b78c2e0f2f8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:27.945313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:27.964902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b934af85a21b4e27aff58924e183194c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.981806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-196c38b3-7ba5-4e7d-b7eb-63d6b2accc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b934af85a21b4e27aff58924e183194c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:27.998273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 985/1952] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:27 2022] DELETE /identity/v3/users/b934af85a21b4e27aff58924e183194c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:28.003634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.003926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.004502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.042258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:28.044362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32221d3384e44f5b9fe25b78c2e0f2f8', 'request_id': 'req-a357923c-63fe-43bd-b730-dcf572512894'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:28.044542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:28.057162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32221d3384e44f5b9fe25b78c2e0f2f8', 'request_id': 'req-a357923c-63fe-43bd-b730-dcf572512894'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:28.059585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:28.072918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32221d3384e44f5b9fe25b78c2e0f2f8', 'request_id': 'req-a357923c-63fe-43bd-b730-dcf572512894'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:28.106193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] The token cache is being invalidate because project 32221d3384e44f5b9fe25b78c2e0f2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:28.106489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:28.110240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a357923c-63fe-43bd-b730-dcf572512894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:28.120201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 968/1953] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:27 2022] DELETE /identity/v3/projects/32221d3384e44f5b9fe25b78c2e0f2f8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:28.122309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32712a-5905-4f9a-9d68-127d0db3f207 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.122596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32712a-5905-4f9a-9d68-127d0db3f207 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.122975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32712a-5905-4f9a-9d68-127d0db3f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.185075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9c32712a-5905-4f9a-9d68-127d0db3f207 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:28.188425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9c32712a-5905-4f9a-9d68-127d0db3f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:28.228100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 986/1954] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:28.251371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.257008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:28.327220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 969/1955] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:28.328644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.328934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.329297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.355728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:28.357725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:28.371462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 970/1956] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:28.372481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.382906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e451cd8-9de8-446c-9b8a-fa916d120aff None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.391060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.391792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.394441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.394865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.398357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:28.400150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.405354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.415459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b3fab-6e8f-4495-b09c-e195b55ebedd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.420170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.420795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.420795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.421091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.432259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.434467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.446283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 987/1957] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:28.459880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 971/1958] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:28.460249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.471646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a22a8-0388-4e8b-ab79-aed48abec4b8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.476938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.478672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.478955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.479359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.480271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.482589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.529373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 988/1959] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:28.533353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.549632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80dfc-b909-49f6-b469-ad7ae53fce71 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.635634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.636472 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.636757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.637084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.638007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.640288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.700339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 972/1960] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:28.703686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.725416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ade8e9-b179-4324-93a3-5a28dbf30aa8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.731464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.732325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.732681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.733156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.734078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.736915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.751851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 989/1961] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:28.755692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.766365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee9dae-7bb2-42ff-a305-81364e3aea7d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.772129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcd0f7-ec17-48ed-862b-6b06e20a9e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.772613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd0f7-ec17-48ed-862b-6b06e20a9e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.772892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd0f7-ec17-48ed-862b-6b06e20a9e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.773627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd0f7-ec17-48ed-862b-6b06e20a9e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.774005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcd0f7-ec17-48ed-862b-6b06e20a9e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.775921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcd0f7-ec17-48ed-862b-6b06e20a9e4b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.793763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 973/1962] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:28.794686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:28.808469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78edbaf-9081-497b-8f2e-0f365cbdd406 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:28.814421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:28.815210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.816010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.816303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] PATH_INFO: `/v3/projects/b3c09f41a9e54c08824bacace7ed3e22/users/500ade435c0d49b9bdb6cb084ef7d833/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.837673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c09f41a9e54c08824bacace7ed3e22, user_id=500ade435c0d49b9bdb6cb084ef7d833, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:28.841357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:28.846502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:28.871266 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 990/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:28 2022] PUT /identity/v3/projects/b3c09f41a9e54c08824bacace7ed3e22/users/500ade435c0d49b9bdb6cb084ef7d833/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:28.876356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373fab-4bca-403e-b104-bf1011631956 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:28.876933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373fab-4bca-403e-b104-bf1011631956 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:28.876933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373fab-4bca-403e-b104-bf1011631956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:28.912459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-07373fab-4bca-403e-b104-bf1011631956 None None] MFA Rules not processed for user `500ade435c0d49b9bdb6cb084ef7d833`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:28.913972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-07373fab-4bca-403e-b104-bf1011631956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:28.956418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:28.992669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 974/1964] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:28.997674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.064043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373fab-4bca-403e-b104-bf1011631956 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.065984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-07373fab-4bca-403e-b104-bf1011631956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.077173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f0c23-92fb-4c74-97e3-90c57c77f43d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.083710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373fab-4bca-403e-b104-bf1011631956 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.086961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.087693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.087990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.088320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.089001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.091686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.092125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.092530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.092873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.093211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] PATH_INFO: `/v3/projects/6e96cfb338554fe887731be35ac1da87` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.094465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e96cfb338554fe887731be35ac1da87)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.096494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.131352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 991/1965] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:28 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:29.133189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.164919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e96cfb338554fe887731be35ac1da87', 'request_id': 'req-84326200-6c62-4497-9deb-0a0e8bd2ff21'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.173530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e96cfb338554fe887731be35ac1da87', 'request_id': 'req-84326200-6c62-4497-9deb-0a0e8bd2ff21'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.183333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e96cfb338554fe887731be35ac1da87', 'request_id': 'req-84326200-6c62-4497-9deb-0a0e8bd2ff21'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.200415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] The token cache is being invalidate because project 6e96cfb338554fe887731be35ac1da87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:29.200698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.201342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.202873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 975/1966] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:29 2022] DELETE /identity/v3/projects/6e96cfb338554fe887731be35ac1da87 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:29.206581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.207979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.212238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ed46b-5d54-4c62-b9fd-3fd950a09f6e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.274181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.274974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.275408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.275687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.283011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.284849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84326200-6c62-4497-9deb-0a0e8bd2ff21 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.285347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.289370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.290094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.290481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.290825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] PATH_INFO: `/v3/users/d04b93adaa3b42c48949f61fdb637059` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.292122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04b93adaa3b42c48949f61fdb637059)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.295678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.314352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 992/1967] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:29 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:29.315814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.317554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.338717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e454e-e27d-493b-82b6-042498f78fe9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.345438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.346823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.346823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.346823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.347691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.349388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.357189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04b93adaa3b42c48949f61fdb637059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.357879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04b93adaa3b42c48949f61fdb637059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.358659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04b93adaa3b42c48949f61fdb637059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.365139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 993/1968] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:29.366559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.368686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.370398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04b93adaa3b42c48949f61fdb637059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.379338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:29.382084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04b93adaa3b42c48949f61fdb637059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:29.383608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76f69c-232d-4763-abe2-ba5ac1d1398b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.389569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.390277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.390562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.390830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] PATH_INFO: `/v3/projects/e73084adf0cb45f086756cc491590978/users/741de5b9f3a447479bb7538ea9eee8ec/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.393537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:29.413456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73084adf0cb45f086756cc491590978, user_id=741de5b9f3a447479bb7538ea9eee8ec, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.413738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 976/1969] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:29 2022] DELETE /identity/v3/users/d04b93adaa3b42c48949f61fdb637059 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:29.416110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.434785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 994/1970] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:29 2022] PUT /identity/v3/projects/e73084adf0cb45f086756cc491590978/users/741de5b9f3a447479bb7538ea9eee8ec/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:29.438702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.529679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83907825-2b96-40d3-b48c-0d4621256f9d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.597492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7398a-646f-4c72-9d23-46ba4e5ca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.598296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7398a-646f-4c72-9d23-46ba4e5ca2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.598581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7398a-646f-4c72-9d23-46ba4e5ca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.598855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7398a-646f-4c72-9d23-46ba4e5ca2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.599912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7398a-646f-4c72-9d23-46ba4e5ca2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.601319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7398a-646f-4c72-9d23-46ba4e5ca2d3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.615653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 977/1971] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:29.619705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.632164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea54c81-4f60-454f-b946-bee1fa244d14 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:29.641035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:29.641904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.642354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.642783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] PATH_INFO: `/v3/projects/e73084adf0cb45f086756cc491590978/users/741de5b9f3a447479bb7538ea9eee8ec/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.644827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73084adf0cb45f086756cc491590978, user_id=741de5b9f3a447479bb7538ea9eee8ec, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:29.647647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:29.675215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 995/1972] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:29 2022] PUT /identity/v3/projects/e73084adf0cb45f086756cc491590978/users/741de5b9f3a447479bb7538ea9eee8ec/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:29.677689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e135-811f-416e-a2e3-117829007e88 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:29.677978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e135-811f-416e-a2e3-117829007e88 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:29.678255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e135-811f-416e-a2e3-117829007e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:29.716934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7259e135-811f-416e-a2e3-117829007e88 None None] MFA Rules not processed for user `741de5b9f3a447479bb7538ea9eee8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:29.718233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7259e135-811f-416e-a2e3-117829007e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.827394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 978/1973] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:29.829720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.831567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.871204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259e135-811f-416e-a2e3-117829007e88 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:29.873661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7259e135-811f-416e-a2e3-117829007e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:29.885420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:30.010685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259e135-811f-416e-a2e3-117829007e88 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.025805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.028586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.028956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.029301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.051482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.051723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3afa23-4cde-4079-9a27-7d23b554f6f2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.054686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.070298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.070987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.071602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.072089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] PATH_INFO: `/v3/users/f63c8affea6f44c6b935e0e94d01e1eb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.074974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63c8affea6f44c6b935e0e94d01e1eb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.080048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.091963 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 979/1974] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:30.093062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:30.095466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.153709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffee09-a629-4ea6-bb0e-59ee6115d9bb service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.159855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.160704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.160996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.161274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] PATH_INFO: `/v3/projects/d3a6dfe8e278449799c3afdedbf0b586` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.162556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a6dfe8e278449799c3afdedbf0b586)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.169983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.232695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63c8affea6f44c6b935e0e94d01e1eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.233667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63c8affea6f44c6b935e0e94d01e1eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.235589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63c8affea6f44c6b935e0e94d01e1eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.255200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63c8affea6f44c6b935e0e94d01e1eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.268486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9ee0eef1-2754-4d62-a2ff-ce0eb96bc420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63c8affea6f44c6b935e0e94d01e1eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.302360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 996/1975] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:29 2022] DELETE /identity/v3/users/f63c8affea6f44c6b935e0e94d01e1eb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:30.303899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a6dfe8e278449799c3afdedbf0b586', 'request_id': 'req-87fcd40f-1b73-46f2-acec-08e8cefaa18b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.309275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b598aa9-0903-4901-ae3d-81831958b236 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.309704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b598aa9-0903-4901-ae3d-81831958b236 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.310053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b598aa9-0903-4901-ae3d-81831958b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.319214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a6dfe8e278449799c3afdedbf0b586', 'request_id': 'req-87fcd40f-1b73-46f2-acec-08e8cefaa18b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.333606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0b598aa9-0903-4901-ae3d-81831958b236 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:30.337516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a6dfe8e278449799c3afdedbf0b586', 'request_id': 'req-87fcd40f-1b73-46f2-acec-08e8cefaa18b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.346330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b598aa9-0903-4901-ae3d-81831958b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.372314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] The token cache is being invalidate because project d3a6dfe8e278449799c3afdedbf0b586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:30.372886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.373774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:30.378341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 980/1976] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:30 2022] DELETE /identity/v3/projects/d3a6dfe8e278449799c3afdedbf0b586 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:30.379896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:30.384904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.414155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:30.444988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 997/1977] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:30.446477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.446941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.447300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.492953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:30.497553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.537126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 998/1978] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:30.537126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:30.537126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.537601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd40f-1b73-46f2-acec-08e8cefaa18b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.693458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58af071-8804-453e-b976-40b7c6438c83 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.697525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:30.703120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1e2ba-6688-4151-812c-bbb34745fa38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.704271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e2ba-6688-4151-812c-bbb34745fa38 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.705281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e2ba-6688-4151-812c-bbb34745fa38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.706040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e2ba-6688-4151-812c-bbb34745fa38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.708377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.709326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.709907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.710182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.715778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.731953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e2ba-6688-4151-812c-bbb34745fa38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.734852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e2ba-6688-4151-812c-bbb34745fa38 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.747786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 999/1979] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:30.749906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.749906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.749906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.778376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:30.779948 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:30.791448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1000/1980] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:30.796688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:30.797522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.798977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.808294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d79b-4877-4f46-bc13-6651d698cd90 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.809995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 981/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:30.814508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.815190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.815436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.815707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.816429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:30.816728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.818427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.835810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1001/1982] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:16:30.837057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:30.856220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f914f-448f-49f9-9169-509b2324251b service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.863209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.864947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.865487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.866281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.867345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:30.869926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:30.906234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 982/1983] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:30 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:30.910222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:30.926005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dbb51-935c-4b86-ba2b-f445fde2507e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:30.997685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:30.998300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:30.998577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:30.998847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:30.999595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.001632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.023832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1002/1984] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:30 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:31.032798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.047835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb43c23-6e1a-431e-9c44-d494819d76cc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.054706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.055453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.055737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.056056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.056794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.059744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.078288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 983/1985] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:31.078928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.098113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e43cb-5c34-41a1-8c8f-65ded92d7f15 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.109165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415954af-b4d4-4ea3-95a9-dd363caa4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.110098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415954af-b4d4-4ea3-95a9-dd363caa4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.110992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415954af-b4d4-4ea3-95a9-dd363caa4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.111683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415954af-b4d4-4ea3-95a9-dd363caa4eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.112940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415954af-b4d4-4ea3-95a9-dd363caa4eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.116218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415954af-b4d4-4ea3-95a9-dd363caa4eb1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.143417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.151262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1003/1986] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:31.156150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411496e0-944a-43af-828e-d17b89e8b56f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.164380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14502070-f165-401f-a926-644b070bc83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.165377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14502070-f165-401f-a926-644b070bc83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.166024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14502070-f165-401f-a926-644b070bc83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.166656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14502070-f165-401f-a926-644b070bc83e admin admin] PATH_INFO: `/v3/projects/0d76006701c847d29adc5adf9c0cafc9/users/f03dc39c396d4c2cad6ef384febba35b/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.201580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14502070-f165-401f-a926-644b070bc83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d76006701c847d29adc5adf9c0cafc9, user_id=f03dc39c396d4c2cad6ef384febba35b, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.204735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14502070-f165-401f-a926-644b070bc83e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.224649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 984/1987] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:31 2022] PUT /identity/v3/projects/0d76006701c847d29adc5adf9c0cafc9/users/f03dc39c396d4c2cad6ef384febba35b/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:31.235911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.236252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.236460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.273328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] MFA Rules not processed for user `f03dc39c396d4c2cad6ef384febba35b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:31.274802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:31.345249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:31.419225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14502070-f165-401f-a926-644b070bc83e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.419805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1004/1988] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:31.433951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.435753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:31.544987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c22e3-6684-4c1a-88d6-61b3c36b6654 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.550480 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.551233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.551643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.551930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] PATH_INFO: `/v3/projects/2aed0be1148f4c629e56b0a56405402f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.553340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aed0be1148f4c629e56b0a56405402f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.555818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.556676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14502070-f165-401f-a926-644b070bc83e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.563646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.564196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.565319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.565627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.566313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.569079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.615868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 985/1989] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:31 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:31.617548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.628558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aed0be1148f4c629e56b0a56405402f', 'request_id': 'req-5a323400-1ebc-4c4b-829d-67facccda94b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.644642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aed0be1148f4c629e56b0a56405402f', 'request_id': 'req-5a323400-1ebc-4c4b-829d-67facccda94b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.651766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aed0be1148f4c629e56b0a56405402f', 'request_id': 'req-5a323400-1ebc-4c4b-829d-67facccda94b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.660829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:31.666983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] The token cache is being invalidate because project 2aed0be1148f4c629e56b0a56405402f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:31.667776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.668609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.670902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1005/1990] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:31 2022] DELETE /identity/v3/projects/2aed0be1148f4c629e56b0a56405402f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:31.675327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.678080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:31.709729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15888913-4637-4374-9def-f6f2d349dafb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.721073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.721923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.723892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.724581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.725803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.729170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.795785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 986/1991] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:31 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:31.799451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.802206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:31.834464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fffed-866e-416d-ba76-b224fe47243e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.847941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.851201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.851586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.851869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.852606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.858015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.893501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 987/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:31.897534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323400-1ebc-4c4b-829d-67facccda94b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.899054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.904992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.905856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.906169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.906495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] PATH_INFO: `/v3/users/c9f0af24aa8046fc8ca3c28123d39428` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.907852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f0af24aa8046fc8ca3c28123d39428)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.909829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.916228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:31.916705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e304f99-a3be-4fc1-a50b-8405d3ec92b2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:31.924345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:31.925371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:31.925985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:31.926234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] PATH_INFO: `/v3/projects/460215dd77aa46708500476b31f21012/users/2c75be195f0141039774c6352342b15e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:31.946520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460215dd77aa46708500476b31f21012, user_id=2c75be195f0141039774c6352342b15e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:31.953395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:31.977825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 988/1993] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:31 2022] PUT /identity/v3/projects/460215dd77aa46708500476b31f21012/users/2c75be195f0141039774c6352342b15e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:31.982714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:31.985716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f0af24aa8046fc8ca3c28123d39428'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.986907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f0af24aa8046fc8ca3c28123d39428'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:31.987969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f0af24aa8046fc8ca3c28123d39428'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.023393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f0af24aa8046fc8ca3c28123d39428'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.039243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f0af24aa8046fc8ca3c28123d39428'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.072246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1006/1994] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:31 2022] DELETE /identity/v3/users/c9f0af24aa8046fc8ca3c28123d39428 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:32.123344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92179362-6b92-4cd5-ab19-8ebabed5fae1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:32.222753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:32.224303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:32.265090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:32.265090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:32.265090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:32.265090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:32.265505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:32.268037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:32.287391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 989/1995] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:32.291027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:32.295518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:32.306535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26351a68-a980-4fc9-ac25-7be4d2ae0e92 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:32.311518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a7e5-bebd-44dc-b68d-dae70f387b5e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:32.316570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:32.317297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:32.318323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:32.318323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:32.321564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:32.322988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee0bdd-afb2-423b-b76b-c8b024cfc35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:32.326713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee0bdd-afb2-423b-b76b-c8b024cfc35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:32.327218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee0bdd-afb2-423b-b76b-c8b024cfc35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:32.329685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee0bdd-afb2-423b-b76b-c8b024cfc35e admin admin] PATH_INFO: `/v3/projects/460215dd77aa46708500476b31f21012/users/2c75be195f0141039774c6352342b15e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:32.334449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee0bdd-afb2-423b-b76b-c8b024cfc35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=460215dd77aa46708500476b31f21012, user_id=2c75be195f0141039774c6352342b15e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:32.341389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee0bdd-afb2-423b-b76b-c8b024cfc35e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:32.369691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 990/1996] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:32 2022] PUT /identity/v3/projects/460215dd77aa46708500476b31f21012/users/2c75be195f0141039774c6352342b15e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:32.372379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:32.372738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:32.373113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:32.415621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] MFA Rules not processed for user `2c75be195f0141039774c6352342b15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:32.419194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:32.431653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:32.482037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:32.484703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:32.514194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1007/1997] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:32.574885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 991/1998] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:32.616886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:32.619228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:32.640271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0247f2-eeec-499d-9dd2-39b8d9d0d4d1 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:32.652554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:32.654541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:32.755134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:32.804954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:32.805682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:32.805963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:32.806324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:32.831128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:32.832845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd534d-c846-40d1-9cba-1be07aa68aed None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:32.833412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:32.840513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:32.841683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:32.842615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:32.843187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] PATH_INFO: `/v3/projects/625feccb341c4b039f0db0644340bb9f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:32.845498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625feccb341c4b039f0db0644340bb9f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:32.849696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:32.866072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1008/1999] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:32.920061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625feccb341c4b039f0db0644340bb9f', 'request_id': 'req-4f81bef9-ba96-45ad-958d-ce1298f87a37'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.931611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625feccb341c4b039f0db0644340bb9f', 'request_id': 'req-4f81bef9-ba96-45ad-958d-ce1298f87a37'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.947001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625feccb341c4b039f0db0644340bb9f', 'request_id': 'req-4f81bef9-ba96-45ad-958d-ce1298f87a37'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.975467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] The token cache is being invalidate because project 625feccb341c4b039f0db0644340bb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:32.975947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.976746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:32.978524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 992/2000] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:32 2022] DELETE /identity/v3/projects/625feccb341c4b039f0db0644340bb9f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:32.983957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:33.002439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f546c3b-2d8b-4bc3-831a-6b45c00c9c54 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:33.014567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:33.016152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:33.089882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:33.129967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:33.142202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bef9-ba96-45ad-958d-ce1298f87a37 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:33.143586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:33.144012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:33.144291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] PATH_INFO: `/v3/users/61c31523d1054be9a9061e06f1604a4b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:33.148383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:33.150287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c31523d1054be9a9061e06f1604a4b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:33.160294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:33.166338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:33.166338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:33.166338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:33.169096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:33.294042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:33.296330 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:33.312962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 993/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:33.318028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c31523d1054be9a9061e06f1604a4b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:33.319826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c31523d1054be9a9061e06f1604a4b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:33.321213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c31523d1054be9a9061e06f1604a4b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:33.343629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c31523d1054be9a9061e06f1604a4b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:33.358330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-77e8cd4e-f02c-4814-bba2-ce9251477a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c31523d1054be9a9061e06f1604a4b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:33.398201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1009/2002] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:32 2022] DELETE /identity/v3/users/61c31523d1054be9a9061e06f1604a4b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:33.959469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:33.962079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:34.038304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916487-3c4b-41ab-8ae5-70b31597a57d service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.188018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.189078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.189549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.190010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] PATH_INFO: `/v3/projects/daecba3963814602a9e8e7364d9ab27f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.191930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daecba3963814602a9e8e7364d9ab27f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.194736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.273343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daecba3963814602a9e8e7364d9ab27f', 'request_id': 'req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.282338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daecba3963814602a9e8e7364d9ab27f', 'request_id': 'req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.293873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daecba3963814602a9e8e7364d9ab27f', 'request_id': 'req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.315116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] The token cache is being invalidate because project daecba3963814602a9e8e7364d9ab27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:34.315506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.316306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-39d4c1a3-f006-43ca-ad9b-348abc9a1a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.318232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 994/2003] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:33 2022] DELETE /identity/v3/projects/daecba3963814602a9e8e7364d9ab27f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:34.325193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.326064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.326637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.352704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:34.354368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:34.428240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:34.451238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.451437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.451818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.456552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1010/2004] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:34.477444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:34.478058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:34.495210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 995/2005] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:34.500170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.516339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61641317-d84e-4d93-8e0e-3ae4feebb308 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.525046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.525772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.526264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.527218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.528130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:34.528495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.530461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.556319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1011/2006] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:34.562769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.582495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87bc1-4885-4171-8158-351b0df33301 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.590376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.591036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.591422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.591703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.595589 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.602257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.617310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:34.653097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.660420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 996/2007] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:34 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:34.665331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb577-9859-4a12-b3e2-4e34cc4e602a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.685048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.687044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:34.743297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.744176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.744450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.745361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.746296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.749034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.775734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2a6a-5d3d-4a8c-b9a6-937345e780ba admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.782417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1012/2008] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:34 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:34.783635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.785058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.785872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.786295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.786718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] PATH_INFO: `/v3/users/500ade435c0d49b9bdb6cb084ef7d833` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.788087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500ade435c0d49b9bdb6cb084ef7d833)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.790349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.797483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200f61-5c00-4973-80ba-a4de19ba8646 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.803606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.804413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.804768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.805546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.806778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.809926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.827197 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1013/2009] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:34.831815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.850950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29330-cf26-4905-a1ad-4c49e92ddede admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.861333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.861563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500ade435c0d49b9bdb6cb084ef7d833'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.862179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500ade435c0d49b9bdb6cb084ef7d833'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.863104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.863393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500ade435c0d49b9bdb6cb084ef7d833'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.863772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.864310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.865275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:34.868416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:34.873707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500ade435c0d49b9bdb6cb084ef7d833'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.882407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1014/2010] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:34.886434 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-799582fb-1af6-4dae-b3d0-8bdaed79d765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500ade435c0d49b9bdb6cb084ef7d833'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:34.887991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:34.889878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:34.905783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94bfe6-8c1f-47ba-9468-a194e73483e8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:34.908544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 997/2011] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:34 2022] DELETE /identity/v3/users/500ade435c0d49b9bdb6cb084ef7d833 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:34.915109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.915566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.915917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.944054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:34.945783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:34.978775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b0656-858b-4182-8017-8a66854240ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:34.979488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0656-858b-4182-8017-8a66854240ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:34.979869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0656-858b-4182-8017-8a66854240ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:34.980145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0656-858b-4182-8017-8a66854240ee admin admin] PATH_INFO: `/v3/projects/914b1beaee7f4531a7f920842b79fccc/users/4f2c048a80e940a8ada3d8df0d39089b/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:34.999297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b0656-858b-4182-8017-8a66854240ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=914b1beaee7f4531a7f920842b79fccc, user_id=4f2c048a80e940a8ada3d8df0d39089b, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:35.001960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b0656-858b-4182-8017-8a66854240ee admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:35.018827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1015/2012] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:34 2022] PUT /identity/v3/projects/914b1beaee7f4531a7f920842b79fccc/users/4f2c048a80e940a8ada3d8df0d39089b/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:35.031353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:35.031787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:35.031891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 998/2013] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:35.032297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:35.045235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:35.046812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:35.058639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:35.080712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] MFA Rules not processed for user `4f2c048a80e940a8ada3d8df0d39089b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:35.081920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:35.115957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:35.125843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91846193-57d8-4c39-8c44-6c2a56b1f03e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:35.170091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1016/2014] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:35.197120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:35.199442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:35.215537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:35.216261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:35.216544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:35.216813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:35.358202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0d74b-54e5-47ab-a019-1e9017148586 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:35.362156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:35.362779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:35.363203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:35.363487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:35.368750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:35.372304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:35.388673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:35.394865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:35.400100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 999/2015] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:35.414338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1017/2016] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:35.951139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:35.952913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:35.982161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fca94-269a-4ada-a4a0-e73876d0f134 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:35.996136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:35.997412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:35.997703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:35.997961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] PATH_INFO: `/v3/projects/b3c09f41a9e54c08824bacace7ed3e22` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:36.001384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c09f41a9e54c08824bacace7ed3e22)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:36.003341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:36.101316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c09f41a9e54c08824bacace7ed3e22', 'request_id': 'req-a300a1f4-9537-4567-9d41-b00bdd177fef'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.111148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c09f41a9e54c08824bacace7ed3e22', 'request_id': 'req-a300a1f4-9537-4567-9d41-b00bdd177fef'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.117977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c09f41a9e54c08824bacace7ed3e22', 'request_id': 'req-a300a1f4-9537-4567-9d41-b00bdd177fef'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.122612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:36.134167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] The token cache is being invalidate because project b3c09f41a9e54c08824bacace7ed3e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:36.134469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.137859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.142810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1000/2017] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:35 2022] DELETE /identity/v3/projects/b3c09f41a9e54c08824bacace7ed3e22 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:36.146264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:36.175259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a37ac-7826-4482-89f8-adc4015d2d1b service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:36.325389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:36.325574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:36.325911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:36.326194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] PATH_INFO: `/v3/users/741de5b9f3a447479bb7538ea9eee8ec` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:36.327687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741de5b9f3a447479bb7538ea9eee8ec)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:36.330805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:36.450442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741de5b9f3a447479bb7538ea9eee8ec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.452888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741de5b9f3a447479bb7538ea9eee8ec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.456627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741de5b9f3a447479bb7538ea9eee8ec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.458680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:36.460390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:36.463286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:36.489792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a1f4-9537-4567-9d41-b00bdd177fef admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:36.500064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741de5b9f3a447479bb7538ea9eee8ec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.504943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:36.505602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:36.505908 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:36.506151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] PATH_INFO: `/v3/users/6582e4fd5e1146b5a753f62cd6b28453` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:36.510512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6582e4fd5e1146b5a753f62cd6b28453)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:36.513737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:36.514594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741de5b9f3a447479bb7538ea9eee8ec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.550637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1018/2018] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:36 2022] DELETE /identity/v3/users/741de5b9f3a447479bb7538ea9eee8ec => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:36.556437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:36.561489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:36.649310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6582e4fd5e1146b5a753f62cd6b28453'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.651421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6582e4fd5e1146b5a753f62cd6b28453'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.652520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6582e4fd5e1146b5a753f62cd6b28453'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.667876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6582e4fd5e1146b5a753f62cd6b28453'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.685245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31c38142-3b42-42c3-8820-072951484dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6582e4fd5e1146b5a753f62cd6b28453'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.689772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd08e-5702-43c3-8841-04cd5489e0f8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:36.702567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:36.704185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:36.704593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:36.704748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] PATH_INFO: `/v3/users/f76216ca0efd497fbd5f8a97b9c5dc47` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:36.706910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76216ca0efd497fbd5f8a97b9c5dc47)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:36.711626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:36.727931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1001/2019] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:36 2022] DELETE /identity/v3/users/6582e4fd5e1146b5a753f62cd6b28453 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:36.735521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:36.736249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:36.736552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:36.791322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:36.793721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:36.843040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76216ca0efd497fbd5f8a97b9c5dc47'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.845009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76216ca0efd497fbd5f8a97b9c5dc47'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.847912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76216ca0efd497fbd5f8a97b9c5dc47'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.883199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1002/2020] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:36.919631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76216ca0efd497fbd5f8a97b9c5dc47'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.940643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e511aaf3-774a-4603-a97b-e9f1d6db9e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76216ca0efd497fbd5f8a97b9c5dc47'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:36.961508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:36.965383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:36.983008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1019/2021] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:36 2022] DELETE /identity/v3/users/f76216ca0efd497fbd5f8a97b9c5dc47 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:36.987527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:36.987847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:36.988967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.026239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:37.026239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:37.063573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9cf14-07d6-4492-91ff-b97b41b8c02c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:37.087953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:37.122543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:37.136235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf4647-22d1-4e9c-b515-cfc422e4300b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:37.138575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf4647-22d1-4e9c-b515-cfc422e4300b service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.138971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf4647-22d1-4e9c-b515-cfc422e4300b service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.139515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf4647-22d1-4e9c-b515-cfc422e4300b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.157774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1020/2022] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:37.190432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:37.203437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ead4df-62d8-4eb9-a832-8582e0a9288c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:37.210549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:37.211195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.211489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.211748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.236498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:37.251222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:37.265505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1021/2023] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:37.268048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:37.269452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:37.286466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0282eeb-5177-4f46-8ca9-c4b463fdd437 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:37.294172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:37.295118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.296170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.296648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] PATH_INFO: `/v3/projects/e73084adf0cb45f086756cc491590978` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.298426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73084adf0cb45f086756cc491590978)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:37.301290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:37.317504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf4647-22d1-4e9c-b515-cfc422e4300b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:37.319046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf4647-22d1-4e9c-b515-cfc422e4300b service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:37.341567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1003/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:37.430309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73084adf0cb45f086756cc491590978', 'request_id': 'req-49a332c1-2744-47db-8350-13405b9260d6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.440642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73084adf0cb45f086756cc491590978', 'request_id': 'req-49a332c1-2744-47db-8350-13405b9260d6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.454137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73084adf0cb45f086756cc491590978', 'request_id': 'req-49a332c1-2744-47db-8350-13405b9260d6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.474325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] The token cache is being invalidate because project e73084adf0cb45f086756cc491590978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:37.474687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.475821 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-49a332c1-2744-47db-8350-13405b9260d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.480849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1022/2025] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:37 2022] DELETE /identity/v3/projects/e73084adf0cb45f086756cc491590978 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:37.486744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd475-3648-44b9-a363-409a14717347 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.487037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd475-3648-44b9-a363-409a14717347 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.487324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd475-3648-44b9-a363-409a14717347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.520484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cedfd475-3648-44b9-a363-409a14717347 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:37.524462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cedfd475-3648-44b9-a363-409a14717347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:37.672295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1004/2026] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:37.684647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.684647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.684647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.736776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:37.738328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:37.755950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1023/2027] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:37.756391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd475-3648-44b9-a363-409a14717347 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:37.773083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd475-3648-44b9-a363-409a14717347 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:37.779831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:37.780577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.780808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.781090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.782088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:37.782551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:37.784581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:37.809189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1005/2028] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:16:37.810115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:37.816256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:37.820457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:37.826288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d5ca8-28b6-46c6-b6f7-db5c77072fbc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:37.835370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:37.835939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.842561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.842884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.843834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:37.845853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:37.855213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffc66-9c15-4e6e-943c-874d77523b60 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:37.866664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:37.867441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:37.867883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:37.868175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] PATH_INFO: `/v3/projects/cdbf4c5fbd304f50a8f720889f972fab` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:37.869572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdbf4c5fbd304f50a8f720889f972fab)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:37.875473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:37.896877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1006/2029] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:37 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:37.902598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:37.961190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbf4c5fbd304f50a8f720889f972fab', 'request_id': 'req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.980926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:37.986070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbf4c5fbd304f50a8f720889f972fab', 'request_id': 'req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:37.999554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbf4c5fbd304f50a8f720889f972fab', 'request_id': 'req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.005621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e79d2-c226-4dc5-8c9b-a57f8b174987 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.020485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] The token cache is being invalidate because project cdbf4c5fbd304f50a8f720889f972fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:38.020965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.021762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.023651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1024/2030] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:37 2022] DELETE /identity/v3/projects/cdbf4c5fbd304f50a8f720889f972fab => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:38.027728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.029078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.073354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.074278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.074636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.075066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.075836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.077376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:38.077875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.111204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1007/2031] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:37 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:38.111204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.111600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.128401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db73e-257e-47d9-b8bf-8944942c2193 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.133694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.134342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.134685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.134957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] PATH_INFO: `/v3/users/bcb9b25085f140ecb1b4ab19d0f7bfc9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.136671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb9b25085f140ecb1b4ab19d0f7bfc9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.139089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.141045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb171a8-fe8c-4159-8eb1-902bd4876e0a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.146734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.147502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.147786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.148064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] PATH_INFO: `/v3/projects/8e4793c93e4c49b89df53f12c13b7053` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.149470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4793c93e4c49b89df53f12c13b7053)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.151991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.212468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb9b25085f140ecb1b4ab19d0f7bfc9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.213509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb9b25085f140ecb1b4ab19d0f7bfc9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.214456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb9b25085f140ecb1b4ab19d0f7bfc9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.220396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4793c93e4c49b89df53f12c13b7053', 'request_id': 'req-90119350-5b85-4c47-bfc1-1c47f1fa84d4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.223614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb9b25085f140ecb1b4ab19d0f7bfc9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.226802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4793c93e4c49b89df53f12c13b7053', 'request_id': 'req-90119350-5b85-4c47-bfc1-1c47f1fa84d4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.232335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb9b25085f140ecb1b4ab19d0f7bfc9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.233463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4793c93e4c49b89df53f12c13b7053', 'request_id': 'req-90119350-5b85-4c47-bfc1-1c47f1fa84d4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.247747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] The token cache is being invalidate because project 8e4793c93e4c49b89df53f12c13b7053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:38.248227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.249199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.251068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1025/2032] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:38 2022] DELETE /identity/v3/projects/8e4793c93e4c49b89df53f12c13b7053 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:38.251621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1008/2033] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:38 2022] DELETE /identity/v3/users/bcb9b25085f140ecb1b4ab19d0f7bfc9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:38.252336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.253945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.255274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.256814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.319849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:38.339712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930f32f-9655-4139-8e80-b0dfdab40751 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.346576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.347268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.347552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.348070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] PATH_INFO: `/v3/users/30bde845bd5d4fe994745f3570206b79` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.349116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bde845bd5d4fe994745f3570206b79)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.349239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119350-5b85-4c47-bfc1-1c47f1fa84d4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.351870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.356210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.357013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.357346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.357521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.358251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.360378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.373036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1026/2034] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:38.376862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.389043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e9dd-d376-4a80-95b5-d82e478b2799 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.394447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.395190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.395523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.396553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.396667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.398275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.409245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1027/2035] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:38.413484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.418178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bde845bd5d4fe994745f3570206b79'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.418906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bde845bd5d4fe994745f3570206b79'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.419562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bde845bd5d4fe994745f3570206b79'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.425574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc389-135a-4768-814d-89c08124db6e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.430971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e4ae-5378-4451-bc38-2b0a8deb716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.432330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e4ae-5378-4451-bc38-2b0a8deb716d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.432477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bde845bd5d4fe994745f3570206b79'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.433079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e4ae-5378-4451-bc38-2b0a8deb716d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.433277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e4ae-5378-4451-bc38-2b0a8deb716d admin admin] PATH_INFO: `/v3/projects/fd6ac5d514104087abcf02ea9ac1746f/users/335a6669e62d41758f21ab8af3e2aab2/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.457534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e4ae-5378-4451-bc38-2b0a8deb716d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6ac5d514104087abcf02ea9ac1746f, user_id=335a6669e62d41758f21ab8af3e2aab2, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.460714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e4ae-5378-4451-bc38-2b0a8deb716d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.463583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bde845bd5d4fe994745f3570206b79'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.479219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1028/2036] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:38 2022] PUT /identity/v3/projects/fd6ac5d514104087abcf02ea9ac1746f/users/335a6669e62d41758f21ab8af3e2aab2/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:38.496145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.496468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.496749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.512666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1009/2037] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:38 2022] DELETE /identity/v3/users/30bde845bd5d4fe994745f3570206b79 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:38.534215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] MFA Rules not processed for user `335a6669e62d41758f21ab8af3e2aab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:38.535748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.549450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:38.621273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.623498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.644813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1029/2038] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:38.649712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.651177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.730882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911538b-7ab6-4751-b3fe-191bd3451365 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.733524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c66339-402d-4fbe-96d8-c63e5ba4d587 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.736871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.737544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.737856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.738138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] PATH_INFO: `/v3/projects/b29aa56504204d879af0358b78b8b032` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.739301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.739553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29aa56504204d879af0358b78b8b032)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.739939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.740227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.741515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.741644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.742276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.744545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.785013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1030/2039] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:38 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:38.786144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.826316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29aa56504204d879af0358b78b8b032', 'request_id': 'req-9baecffc-6940-414b-95b3-c2b646c555b1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.844441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29aa56504204d879af0358b78b8b032', 'request_id': 'req-9baecffc-6940-414b-95b3-c2b646c555b1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.865181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29aa56504204d879af0358b78b8b032', 'request_id': 'req-9baecffc-6940-414b-95b3-c2b646c555b1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.875721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749968f-c73f-4cef-bf0e-d13afb59eb73 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.878298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:38.885506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] The token cache is being invalidate because project b29aa56504204d879af0358b78b8b032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:38.895182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.896331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:38.902357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1010/2040] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:38 2022] DELETE /identity/v3/projects/b29aa56504204d879af0358b78b8b032 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:38.903277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:38.904678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:38.939088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:38.960074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15360a-5974-4bf6-b0c6-990566e9c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:38.960798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15360a-5974-4bf6-b0c6-990566e9c6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:38.961192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15360a-5974-4bf6-b0c6-990566e9c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:38.961534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15360a-5974-4bf6-b0c6-990566e9c6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:38.962674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15360a-5974-4bf6-b0c6-990566e9c6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:38.965787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15360a-5974-4bf6-b0c6-990566e9c6d1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:38.993735 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baecffc-6940-414b-95b3-c2b646c555b1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:38.999377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.000120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.000656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.001011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] PATH_INFO: `/v3/projects/80cfe3c61c5e4375aadea737c79ee04a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.002273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cfe3c61c5e4375aadea737c79ee04a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.004366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.015251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1031/2041] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:38 2022] POST /identity/v3/users => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:39.016696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.017044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.017520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.061938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:39.063312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.066801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cfe3c61c5e4375aadea737c79ee04a', 'request_id': 'req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.073094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cfe3c61c5e4375aadea737c79ee04a', 'request_id': 'req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.080622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cfe3c61c5e4375aadea737c79ee04a', 'request_id': 'req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.095493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] The token cache is being invalidate because project 80cfe3c61c5e4375aadea737c79ee04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:39.095878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.096569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.101737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1011/2042] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:38 2022] DELETE /identity/v3/projects/80cfe3c61c5e4375aadea737c79ee04a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:39.101737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.101737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.158847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1032/2043] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:39.159741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.175479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.191467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61014d8b-d847-4f50-908b-3aeace1b6a5c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.200749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.202664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.202944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.204088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd198ef-a5ac-4cdf-9f48-8051e6c7fe75 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.204560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] PATH_INFO: `/v3/users/7b854dc37b764d35bbd599daf41ff62a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.207521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b854dc37b764d35bbd599daf41ff62a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.209284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd9af1-6b26-4ca4-86ce-6cbf99f324cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.210014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9af1-6b26-4ca4-86ce-6cbf99f324cb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.210248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9af1-6b26-4ca4-86ce-6cbf99f324cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.210528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9af1-6b26-4ca4-86ce-6cbf99f324cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.211367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.211942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd9af1-6b26-4ca4-86ce-6cbf99f324cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.213861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd9af1-6b26-4ca4-86ce-6cbf99f324cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.233063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1012/2044] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:39.234493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.235337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.235337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.259414 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:39.261249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.285213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1013/2045] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:39.285213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.299324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e0893-22a1-4e62-95bb-4d03bf4f0acb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.305704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.307411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.308449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.308773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] PATH_INFO: `/v3/projects/28b2876508f54965a202cdd517cd6cd9/users/0ab8e0529df6486b80562b81b584611b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.323101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b854dc37b764d35bbd599daf41ff62a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.325217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b854dc37b764d35bbd599daf41ff62a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.326395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b854dc37b764d35bbd599daf41ff62a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.332508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b2876508f54965a202cdd517cd6cd9, user_id=0ab8e0529df6486b80562b81b584611b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.335401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.338107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:39.346628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b854dc37b764d35bbd599daf41ff62a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.357950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1014/2046] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:39 2022] PUT /identity/v3/projects/28b2876508f54965a202cdd517cd6cd9/users/0ab8e0529df6486b80562b81b584611b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:39.358531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b854dc37b764d35bbd599daf41ff62a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.358859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.365191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.385539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1033/2047] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:39 2022] DELETE /identity/v3/users/7b854dc37b764d35bbd599daf41ff62a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:39.387672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.390248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.480537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:39.481211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df5cbd-e798-481e-914a-f536649f0a4a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.503490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0c88-ffc1-4355-b3e5-f037c114eb74 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.521114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.521114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.521114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.521114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.521608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.521608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.538076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1034/2048] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:39.538076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.538076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.552241 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae60348-a3c6-4209-b717-445fbbf7bf7f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.558381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.559228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.559639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.559918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] PATH_INFO: `/v3/users/f03dc39c396d4c2cad6ef384febba35b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.561329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03dc39c396d4c2cad6ef384febba35b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.563368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.572952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.574447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.574969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.575601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.576698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:39.577296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.579211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.594600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1015/2049] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:39.596134 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.608950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d36bd-ff40-4e0c-ae74-f369cc81f281 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.616521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.617431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.617733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.618015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] PATH_INFO: `/v3/projects/28b2876508f54965a202cdd517cd6cd9/users/0ab8e0529df6486b80562b81b584611b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.620965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b2876508f54965a202cdd517cd6cd9, user_id=0ab8e0529df6486b80562b81b584611b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.623914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.641184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1016/2050] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:39 2022] PUT /identity/v3/projects/28b2876508f54965a202cdd517cd6cd9/users/0ab8e0529df6486b80562b81b584611b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:39.642118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.656217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03dc39c396d4c2cad6ef384febba35b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.660988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03dc39c396d4c2cad6ef384febba35b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.661724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03dc39c396d4c2cad6ef384febba35b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.675488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03dc39c396d4c2cad6ef384febba35b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.684034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5c1bf88-e69b-4b34-806d-1b9f2a294e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03dc39c396d4c2cad6ef384febba35b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.699355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1035/2051] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:39 2022] DELETE /identity/v3/users/f03dc39c396d4c2cad6ef384febba35b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:39.700875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e58f-8a11-4f8b-b849-931b380a2d01 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.701237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e58f-8a11-4f8b-b849-931b380a2d01 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.701584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e58f-8a11-4f8b-b849-931b380a2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.726639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b06bd-41ae-450b-bb54-efb7c1583cc0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.747607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-32d5e58f-8a11-4f8b-b849-931b380a2d01 None None] MFA Rules not processed for user `0ab8e0529df6486b80562b81b584611b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:39.749330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-32d5e58f-8a11-4f8b-b849-931b380a2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.762769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:39.799846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653860-ab30-4d12-9558-729af644748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.800459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653860-ab30-4d12-9558-729af644748c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.800737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653860-ab30-4d12-9558-729af644748c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.801004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653860-ab30-4d12-9558-729af644748c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.801654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653860-ab30-4d12-9558-729af644748c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.803636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653860-ab30-4d12-9558-729af644748c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.830772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1036/2052] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:39.832044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.832330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.832602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.840288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1017/2053] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:39 2022] POST /identity/v3/projects => generated 355 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:39.840288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653860-ab30-4d12-9558-729af644748c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.841628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-27653860-ab30-4d12-9558-729af644748c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.853753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:39.855334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.897378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:39.916395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653860-ab30-4d12-9558-729af644748c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.920550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1037/2054] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:39.924081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.924081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.926412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.927072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.927381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.927654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] PATH_INFO: `/v3/projects/5ecd894346ff4a9f8bb3f5e9a78acc1a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.928838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecd894346ff4a9f8bb3f5e9a78acc1a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.930744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.936288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969df0c-f25d-4e88-bfd3-a201b9bce027 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:39.940961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:39.941575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:39.941852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:39.942124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:39.942778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:39.945024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:39.967879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1038/2055] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:39 2022] POST /identity/v3/users => generated 278 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:39.968693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:39.970219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:39.984695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecd894346ff4a9f8bb3f5e9a78acc1a', 'request_id': 'req-119935de-1634-4a09-8a82-2e82fc0d7a95'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.990881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecd894346ff4a9f8bb3f5e9a78acc1a', 'request_id': 'req-119935de-1634-4a09-8a82-2e82fc0d7a95'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:39.998513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecd894346ff4a9f8bb3f5e9a78acc1a', 'request_id': 'req-119935de-1634-4a09-8a82-2e82fc0d7a95'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.011804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] The token cache is being invalidate because project 5ecd894346ff4a9f8bb3f5e9a78acc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:40.011978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.012651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.018442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1018/2056] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:39 2022] DELETE /identity/v3/projects/5ecd894346ff4a9f8bb3f5e9a78acc1a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:40.018442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.019694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.038931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3b147-17a1-4fb8-9ecf-b702e207630f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.069212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:40.085321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119935de-1634-4a09-8a82-2e82fc0d7a95 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.089117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.089877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.090158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.090421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.092241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.094326 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.094937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.095242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.095513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.097226 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.174061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.175584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.177933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.180014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334efc-2205-495d-a88d-549ace524922 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.187098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1039/2057] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:40.187963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.189355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.201816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1019/2058] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:40.215498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e07081-749e-409e-b77d-f8563f0a69a2 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.215794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bed1-981f-4e07-8278-f835c81320a8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.215794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bed1-981f-4e07-8278-f835c81320a8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.216276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bed1-981f-4e07-8278-f835c81320a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.224503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.225170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.225449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.225719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.226418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.228098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.247019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4b01bed1-981f-4e07-8278-f835c81320a8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:40.251532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4b01bed1-981f-4e07-8278-f835c81320a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.262760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1040/2059] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:40.264430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.267415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1020/2060] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:40.269221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.269674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.269992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.281949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafbd2e-1bcb-4240-985f-d3ae22635183 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.295514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:40.296851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.300581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.301213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.301497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.301772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.302472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.304307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.322845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1021/2061] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:40.324843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.332305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1041/2062] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:40.336358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.338119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e733c25-6458-4dee-8728-2a51683a64ac None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.352247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.353377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.353843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39b1c-c025-4417-adfc-d8c17cd7be80 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.354010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.354634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.356046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:40.356588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.358753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.366510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.367203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.367485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.367757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] PATH_INFO: `/v3/projects/6c4c2f75b7dd41189ab3f4202f33bd07/users/58ef218a19fe4d3a90027c3f080ecce3/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.379210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1022/2063] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:40.381248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.388854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:40.401449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4c2f75b7dd41189ab3f4202f33bd07, user_id=58ef218a19fe4d3a90027c3f080ecce3, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.407713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.440112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1042/2064] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:40 2022] PUT /identity/v3/projects/6c4c2f75b7dd41189ab3f4202f33bd07/users/58ef218a19fe4d3a90027c3f080ecce3/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:40.441376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.441577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902a9f-1a0b-44dc-879a-0d042f3e279f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.445270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.541166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec755-aa89-4046-941c-6e5ee0b88163 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.554820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.556382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.558166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.558467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] PATH_INFO: `/v3/users/335a6669e62d41758f21ab8af3e2aab2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.559871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335a6669e62d41758f21ab8af3e2aab2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.562689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8dca2-8599-4c98-9dd0-060478b13603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.563115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.563427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dca2-8599-4c98-9dd0-060478b13603 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.563743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dca2-8599-4c98-9dd0-060478b13603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.564093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dca2-8599-4c98-9dd0-060478b13603 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.564884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8dca2-8599-4c98-9dd0-060478b13603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.576524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8dca2-8599-4c98-9dd0-060478b13603 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.624371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1023/2065] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:40.625813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.626110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.626651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.661454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] MFA Rules not processed for user `58ef218a19fe4d3a90027c3f080ecce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:40.663038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.681733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335a6669e62d41758f21ab8af3e2aab2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.683593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335a6669e62d41758f21ab8af3e2aab2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.692209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335a6669e62d41758f21ab8af3e2aab2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.710754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:40.717070 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335a6669e62d41758f21ab8af3e2aab2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.726324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335a6669e62d41758f21ab8af3e2aab2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.741274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1043/2066] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:40 2022] DELETE /identity/v3/users/335a6669e62d41758f21ab8af3e2aab2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:40.741824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.745019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.746775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1024/2067] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:40.747681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.749117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.836278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ccba-8cb7-4128-8f8e-80a3d4b7c05a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.838520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b310-4018-4c73-9e34-28e94bfbd483 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.842279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d272e02-ec9e-4332-bd69-994551e89cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.842917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d272e02-ec9e-4332-bd69-994551e89cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.843264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d272e02-ec9e-4332-bd69-994551e89cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.843539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d272e02-ec9e-4332-bd69-994551e89cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.844241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d272e02-ec9e-4332-bd69-994551e89cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.844452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.845526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.846028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.846269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] PATH_INFO: `/v3/projects/0d76006701c847d29adc5adf9c0cafc9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.846928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d272e02-ec9e-4332-bd69-994551e89cd8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.847936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d76006701c847d29adc5adf9c0cafc9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.850374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:40.861142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:40.874868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1025/2068] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:40.876276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.876565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.876842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.899335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:40.900543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.915811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d76006701c847d29adc5adf9c0cafc9', 'request_id': 'req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.929115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d76006701c847d29adc5adf9c0cafc9', 'request_id': 'req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.936092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d76006701c847d29adc5adf9c0cafc9', 'request_id': 'req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.951127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] The token cache is being invalidate because project 0d76006701c847d29adc5adf9c0cafc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:40.951443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.952096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:40.953630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1044/2069] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:40 2022] DELETE /identity/v3/projects/0d76006701c847d29adc5adf9c0cafc9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:40.956727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.956727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.975784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1026/2070] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:40.976785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:40.978116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:40.990317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093cc3c-3d79-48a1-ae91-9271c4f1b2bb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:40.994980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:40.995679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:40.996020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:40.996356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:40.997109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:40.998745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.009366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1027/2071] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:41.010458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.016131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.024313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca29f6-8417-48f1-8bbe-8bcc2ec8754e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.030191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac443d5-bb21-4d70-b73f-ad468bd8bb9c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.030583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.031392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.031709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.032021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.032720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.034627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.035407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.036219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.036508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.036783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] PATH_INFO: `/v3/users/2c75be195f0141039774c6352342b15e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.037974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c75be195f0141039774c6352342b15e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.039917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.064086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1045/2072] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:40 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:41.064998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.066806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.092253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c75be195f0141039774c6352342b15e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.092922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c75be195f0141039774c6352342b15e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.093539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c75be195f0141039774c6352342b15e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.101090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c75be195f0141039774c6352342b15e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.103283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:41.111413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c75be195f0141039774c6352342b15e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.130786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad58e-e852-4b45-8e70-b1ab2e97944a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.134411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1028/2073] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:41 2022] DELETE /identity/v3/users/2c75be195f0141039774c6352342b15e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:41.134411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.134411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.175910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:41.205583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.206216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.206596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.206881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.208860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.227602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4112-9ec5-46ba-8541-b7188262e626 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.233597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.234512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.235046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.235382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.236085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.237685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.251046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1029/2074] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:41.251755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.253463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.268293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7334ac-9a7f-4c60-b0d7-1cc5e2ba7b3e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.273608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.274280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.274590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.274877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.275637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.277827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.282795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.284449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.297768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1046/2075] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:41.298660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.308939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1030/2076] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:41 2022] POST /identity/v3/users => generated 285 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:41.309122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3768df-cca5-498f-a901-9baee9928ae8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.310791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.313855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456badf4-f4c5-49cf-9dc1-06affd7066ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.314534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456badf4-f4c5-49cf-9dc1-06affd7066ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.314817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456badf4-f4c5-49cf-9dc1-06affd7066ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.315114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456badf4-f4c5-49cf-9dc1-06affd7066ac admin admin] PATH_INFO: `/v3/projects/3df2afdd1ff74f6986597df07f8cb420/users/a25654a37cc547ff80540ade94a09151/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.324445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48914-7ac3-415e-96aa-bdfa9f55d506 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.329377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.329995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.330275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.330546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.331293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.332918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.334200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456badf4-f4c5-49cf-9dc1-06affd7066ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df2afdd1ff74f6986597df07f8cb420, user_id=a25654a37cc547ff80540ade94a09151, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.340398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456badf4-f4c5-49cf-9dc1-06affd7066ac admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.365104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1031/2077] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:41.368782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.379220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1047/2078] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:41 2022] PUT /identity/v3/projects/3df2afdd1ff74f6986597df07f8cb420/users/a25654a37cc547ff80540ade94a09151/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:41.381646 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2a13-8298-48c0-9e2a-06dac4084842 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.382449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.382956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.383434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.426295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] MFA Rules not processed for user `a25654a37cc547ff80540ade94a09151`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:41.427533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.465510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.466278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.466581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.466860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] PATH_INFO: `/v3/projects/e8e3e96f2c724bfa962bbfd109a143b1/users/dcb8e12750b14ccaa0ca2536ed4f1fff/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.494076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e3e96f2c724bfa962bbfd109a143b1, user_id=dcb8e12750b14ccaa0ca2536ed4f1fff, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.500164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.523360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1032/2079] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:41 2022] PUT /identity/v3/projects/e8e3e96f2c724bfa962bbfd109a143b1/users/dcb8e12750b14ccaa0ca2536ed4f1fff/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:41.531021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.537054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.549251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1048/2080] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:41.549251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.563624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037208e-b5d2-47fe-a992-8ecb2d3dba6e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.584722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:41.634506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:41.650545 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.650990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963813df-3848-4508-86e1-9ef3f8898e5d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.651230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.651906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.652415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.653286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.655784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.657123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.658756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.659241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.659682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] PATH_INFO: `/v3/projects/460215dd77aa46708500476b31f21012` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.664408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460215dd77aa46708500476b31f21012)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.666473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.668988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1049/2081] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:41.672971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.689049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f252-839f-49f2-8271-1ff04f4b16d2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.700790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.700790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.701177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.702346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.702346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.708444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.750488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460215dd77aa46708500476b31f21012', 'request_id': 'req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.750896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1050/2082] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:41 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:41.752116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.762710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460215dd77aa46708500476b31f21012', 'request_id': 'req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.779177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460215dd77aa46708500476b31f21012', 'request_id': 'req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.790679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] The token cache is being invalidate because project 460215dd77aa46708500476b31f21012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:41.790974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.791664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:41.794226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1033/2083] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:41 2022] DELETE /identity/v3/projects/460215dd77aa46708500476b31f21012 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:41.795324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:41.796960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:41.894361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd573ee3-8ca7-4146-962e-46988057a0cc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.896070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5ab4a-fcd2-49d1-ba2e-6158f9997b57 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:41.899665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ed1b9-caba-40dd-b996-99f2a39920ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.900347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ed1b9-caba-40dd-b996-99f2a39920ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.900631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ed1b9-caba-40dd-b996-99f2a39920ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.900731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4441e2-f176-433c-b52b-129c2d6da2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:41.901096 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ed1b9-caba-40dd-b996-99f2a39920ae admin admin] PATH_INFO: `/v3/projects/e8e3e96f2c724bfa962bbfd109a143b1/users/dcb8e12750b14ccaa0ca2536ed4f1fff/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.901969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4441e2-f176-433c-b52b-129c2d6da2db admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.902230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4441e2-f176-433c-b52b-129c2d6da2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.902503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4441e2-f176-433c-b52b-129c2d6da2db admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.903210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4441e2-f176-433c-b52b-129c2d6da2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.903894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ed1b9-caba-40dd-b996-99f2a39920ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e3e96f2c724bfa962bbfd109a143b1, user_id=dcb8e12750b14ccaa0ca2536ed4f1fff, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:41.905084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4441e2-f176-433c-b52b-129c2d6da2db admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.906873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ed1b9-caba-40dd-b996-99f2a39920ae admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:41.926782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1051/2084] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:41 2022] PUT /identity/v3/projects/e8e3e96f2c724bfa962bbfd109a143b1/users/dcb8e12750b14ccaa0ca2536ed4f1fff/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:41.927910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.928308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.928677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.953526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1034/2085] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:41 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:41.954877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:41.955257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:41.955529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:41.960474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:41.962258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.002423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] MFA Rules not processed for user `dcb8e12750b14ccaa0ca2536ed4f1fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:42.003994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.043404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:42.098140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1052/2086] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:42.099121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.101976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1035/2087] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:42.102650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.103036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.115517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145791-743b-4117-b3cf-3888f53d29a0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.115883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a47eb-29a5-452a-badc-374924e45b8a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.121257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107b9fd-e63b-4646-be4f-9b1a8b94740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.121978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.122124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107b9fd-e63b-4646-be4f-9b1a8b94740b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.122359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107b9fd-e63b-4646-be4f-9b1a8b94740b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.122565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.122963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.123282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] PATH_INFO: `/v3/projects/fd6ac5d514104087abcf02ea9ac1746f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.128044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107b9fd-e63b-4646-be4f-9b1a8b94740b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.129909 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107b9fd-e63b-4646-be4f-9b1a8b94740b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.131693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6ac5d514104087abcf02ea9ac1746f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.133185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.136344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107b9fd-e63b-4646-be4f-9b1a8b94740b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.151903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1036/2088] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:42.153287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.153577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.153851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.183478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:42.184670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.193032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1037/2089] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:42.197655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.199821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.221818 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6ac5d514104087abcf02ea9ac1746f', 'request_id': 'req-63cd06a7-9571-47e6-b20c-0f7c5b877b68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.234969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:42.236516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6ac5d514104087abcf02ea9ac1746f', 'request_id': 'req-63cd06a7-9571-47e6-b20c-0f7c5b877b68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.247976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6ac5d514104087abcf02ea9ac1746f', 'request_id': 'req-63cd06a7-9571-47e6-b20c-0f7c5b877b68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.263304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] The token cache is being invalidate because project fd6ac5d514104087abcf02ea9ac1746f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:42.263764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.264435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.268825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1053/2090] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:42 2022] DELETE /identity/v3/projects/fd6ac5d514104087abcf02ea9ac1746f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:42.268825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.268825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.276059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26853680-4ab0-49eb-9840-0ec254d1a9d3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.353455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd06a7-9571-47e6-b20c-0f7c5b877b68 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.363767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.366143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.367202 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.368315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.369152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.372640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.378860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.379722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.380152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.380569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.382774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.400457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1054/2091] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:42.402559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.405436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.431433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601cf9d-934b-410a-8e79-71c449d4221a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.451802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.452800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.455377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.455872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.456993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:42.457582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.459685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.473760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.475248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.476501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1055/2092] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:42.477864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.482276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.499746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496902c-c9f6-446e-971a-628f276f06fe admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.505739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.506607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1038/2093] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:42.506874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.507356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.507825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] PATH_INFO: `/v3/users/0ab8e0529df6486b80562b81b584611b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.509663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab8e0529df6486b80562b81b584611b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.512265 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.521540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.547416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412dc52-bb4f-416c-8a59-aff5230dc542 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.553950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.554789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.555075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.555435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] PATH_INFO: `/v3/projects/775df477eee74d22a0861891c4dcd6ef/users/db2958fa51fc455782dff7480abfc83c/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.579059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab8e0529df6486b80562b81b584611b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.579855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab8e0529df6486b80562b81b584611b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.581321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab8e0529df6486b80562b81b584611b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.581528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775df477eee74d22a0861891c4dcd6ef, user_id=db2958fa51fc455782dff7480abfc83c, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.584147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.587110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:42.599812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab8e0529df6486b80562b81b584611b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.603297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1039/2094] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:42 2022] PUT /identity/v3/projects/775df477eee74d22a0861891c4dcd6ef/users/db2958fa51fc455782dff7480abfc83c/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:42.605031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.611306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.615011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9e50b832-26d9-4be9-8606-3844ac305e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab8e0529df6486b80562b81b584611b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:42.630759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1056/2095] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:42 2022] DELETE /identity/v3/users/0ab8e0529df6486b80562b81b584611b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:42.633877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.633877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.633877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.672648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] MFA Rules not processed for user `db2958fa51fc455782dff7480abfc83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:42.674143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.702432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe48d-6dc9-4e25-8a3d-caf900a1acd9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.719836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:42.776076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1057/2096] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:42.776076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.776076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.794413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.795402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.797487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.798063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.799787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.804041 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.849895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1040/2097] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:42 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:42.849895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:42.852436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:42.902754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8282d-d50d-44df-bc5d-11592520daf7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.953922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c673-8120-4d30-9f76-1295f306105c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:42.958861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.959592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.960082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.960911 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.961741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:42.964412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:42.974405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:42.975148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:42.975469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:42.975747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:42.977658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.005025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1041/2098] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:43.006143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.019461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:43.061908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.063737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.074732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1058/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:43.075674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.090816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430dd6-c2c6-4a1e-8f5d-5789526ed38c service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.096972 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.097692 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.098036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.098375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.099178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.101178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.102094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637e0b5-542b-4084-b492-413f52cf9d55 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.117496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.119407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.119728 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.120903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.121531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.123866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.142527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1059/2100] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/users => generated 299 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:43.143490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.147252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.161220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b75e-0efa-419e-ba4b-7d34db978cf2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.171498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.172970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.173490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.173644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] PATH_INFO: `/v3/projects/28b2876508f54965a202cdd517cd6cd9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.174966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b2876508f54965a202cdd517cd6cd9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.182279 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.196260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1042/2101] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:43.201142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.204451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:43.238164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96879-8499-4266-941e-1ff6df746b19 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.248008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.248736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.249668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.250002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.250763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.252803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.267546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1043/2102] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:43.268471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.282440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb95d-c668-4113-b330-483219da1d53 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.293103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b2876508f54965a202cdd517cd6cd9', 'request_id': 'req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:43.302101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b2876508f54965a202cdd517cd6cd9', 'request_id': 'req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:43.310357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b2876508f54965a202cdd517cd6cd9', 'request_id': 'req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:43.328546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] The token cache is being invalidate because project 28b2876508f54965a202cdd517cd6cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:43.329365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:43.330156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:43.332419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1060/2103] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:43 2022] DELETE /identity/v3/projects/28b2876508f54965a202cdd517cd6cd9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:43.336041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.337530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.382725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc43f0-1a8f-4b94-ac21-0cfac5e64dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.383391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc43f0-1a8f-4b94-ac21-0cfac5e64dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.383677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc43f0-1a8f-4b94-ac21-0cfac5e64dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.383952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc43f0-1a8f-4b94-ac21-0cfac5e64dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.384644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc43f0-1a8f-4b94-ac21-0cfac5e64dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.386407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc43f0-1a8f-4b94-ac21-0cfac5e64dbf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.396498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1044/2104] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:43.397675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.397962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.398237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.405781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aff02d-ea7b-4dd6-b7b2-f420d53a34e2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.410574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d38e9b-1e10-4c5b-998c-78d6b61b40aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.411460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d38e9b-1e10-4c5b-998c-78d6b61b40aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.411815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d38e9b-1e10-4c5b-998c-78d6b61b40aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.412159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d38e9b-1e10-4c5b-998c-78d6b61b40aa admin admin] PATH_INFO: `/v3/projects/9d79b12eb80b436bbab7aedfd87e8817/users/07d227c12fb1400bbc787b53703fde1b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.419373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:43.420612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.429038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1045/2105] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:43.429931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.431306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.432297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d38e9b-1e10-4c5b-998c-78d6b61b40aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d79b12eb80b436bbab7aedfd87e8817, user_id=07d227c12fb1400bbc787b53703fde1b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.435412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d38e9b-1e10-4c5b-998c-78d6b61b40aa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.448655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604984c-fc68-409c-8b95-eff6ecad9c0c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.451567 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1061/2106] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:43 2022] PUT /identity/v3/projects/9d79b12eb80b436bbab7aedfd87e8817/users/07d227c12fb1400bbc787b53703fde1b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:43.452859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.453169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.453414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.473812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:43.475309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.523258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.524480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.524773 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.525052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.525769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.527955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.543302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1046/2107] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:43.543302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.549256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1062/2108] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:43.550783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.554078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09510-ea65-4a29-80be-8a2d4c25221f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.559799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.560420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.560701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.560970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.561652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.563305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.569951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613aad2-accf-4a92-8c52-3144e169822f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.574581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1047/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:43.575542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.582679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.582679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.582679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.582679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] PATH_INFO: `/v3/projects/607a928b4d2e42d2bfea19e14e6f6f2f/users/9402e16455b44acab40fa5a19fcdf0c2/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.585834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:43.591511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec4c88-08be-47d7-9241-d6cfd862ec85 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.599347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.600092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.600374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.600558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=607a928b4d2e42d2bfea19e14e6f6f2f, user_id=9402e16455b44acab40fa5a19fcdf0c2, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.600670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.601439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:43.601793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.603916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.604054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.618686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1048/2110] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:43.619445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.623214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1063/2111] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:43 2022] PUT /identity/v3/projects/607a928b4d2e42d2bfea19e14e6f6f2f/users/9402e16455b44acab40fa5a19fcdf0c2/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:43.623912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.633022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:43.636219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9103-7fa2-455c-8a8f-53f763f2945d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.702987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990bcc-766e-4fc2-82d8-22ce92ab15b8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.708168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.708785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.709063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.709354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.710049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.711983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.714934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99715822-4d84-4140-ac65-c2c0e4fdff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.715857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715822-4d84-4140-ac65-c2c0e4fdff6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.716143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715822-4d84-4140-ac65-c2c0e4fdff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.716549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715822-4d84-4140-ac65-c2c0e4fdff6d admin admin] PATH_INFO: `/v3/projects/9d79b12eb80b436bbab7aedfd87e8817/users/07d227c12fb1400bbc787b53703fde1b/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.719137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99715822-4d84-4140-ac65-c2c0e4fdff6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d79b12eb80b436bbab7aedfd87e8817, user_id=07d227c12fb1400bbc787b53703fde1b, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.722753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99715822-4d84-4140-ac65-c2c0e4fdff6d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.736594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1049/2112] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:43 2022] PUT /identity/v3/projects/9d79b12eb80b436bbab7aedfd87e8817/users/07d227c12fb1400bbc787b53703fde1b/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:43.738136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.738424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.738802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.741207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1064/2113] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:43.745719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.770145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] MFA Rules not processed for user `9402e16455b44acab40fa5a19fcdf0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:43.771405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.809516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd372a-838a-4768-a720-21b0313c315a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.814636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0c4fa-6d2b-42b1-b225-686c7693fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.815274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0c4fa-6d2b-42b1-b225-686c7693fd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.815553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0c4fa-6d2b-42b1-b225-686c7693fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.815825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0c4fa-6d2b-42b1-b225-686c7693fd23 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.816470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0c4fa-6d2b-42b1-b225-686c7693fd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.818411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0c4fa-6d2b-42b1-b225-686c7693fd23 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.848670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1065/2114] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:43.848670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.848969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1050/2115] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:43.849066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.849066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.850528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.862230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ea4e-7927-48b7-bac1-37442295ffc7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.867027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.867674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.867961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.868237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.868922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.870591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.880727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] MFA Rules not processed for user `07d227c12fb1400bbc787b53703fde1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:43.881401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.882086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1051/2116] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:43.884123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.886864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:43.961349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed40a-c928-4699-9bea-7d42508a33a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.966723 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.967365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.967650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.968042 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1066/2117] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:43.968152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.968783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.977364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:43.980175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.981843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.983039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd44b1-9b9a-42d1-b9d4-f5b729353b99 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:43.989484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:43.990101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:43.990380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:43.990694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:43.991401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1052/2118] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:43.991513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:43.992332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:43.993299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:43.993599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:44.004360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1067/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:44.008195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.017640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758cb5c-bc3f-41e7-97ee-23330d9e8e68 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.019330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728de65c-213a-445f-81d1-3f09af5385ea admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.021512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.022035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.022340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.022619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.024395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:44.024935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.025797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.026068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.027023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] PATH_INFO: `/v3/projects/63b0f9fa96e24a9180fc147e87d36a33/users/9dab2ea67387445593e776db5a053693/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.030860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:44.043204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b0f9fa96e24a9180fc147e87d36a33, user_id=9dab2ea67387445593e776db5a053693, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.045860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.059630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1068/2120] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:44 2022] PUT /identity/v3/projects/63b0f9fa96e24a9180fc147e87d36a33/users/9dab2ea67387445593e776db5a053693/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:44.068477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.095834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.097311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549b745-7954-4b0a-82f8-71771011db9e service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.107296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1053/2121] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:44.108525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.108807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.109090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.127834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4386f6-d16c-4fc3-897a-e562328484fa admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.133404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.134052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.134334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.134609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] PATH_INFO: `/v3/users/9402e16455b44acab40fa5a19fcdf0c2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.138115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9402e16455b44acab40fa5a19fcdf0c2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.139655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] MFA Rules not processed for user `9dab2ea67387445593e776db5a053693`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:44.140506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.140877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:44.195339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9402e16455b44acab40fa5a19fcdf0c2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:44.196089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9402e16455b44acab40fa5a19fcdf0c2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:44.196782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9402e16455b44acab40fa5a19fcdf0c2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:44.214196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9402e16455b44acab40fa5a19fcdf0c2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:44.222990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1054/2122] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:44.224004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-adc571f5-facc-429a-85b4-108ed10cb357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9402e16455b44acab40fa5a19fcdf0c2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:44.227943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.235124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:44.245940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1069/2123] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:44 2022] DELETE /identity/v3/users/9402e16455b44acab40fa5a19fcdf0c2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:44.249174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.250917 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.251012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7ae2-a278-4d95-bf60-4a090b2a7be4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.251102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.278981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:44.280394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:44.347359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.348884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.348884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.349087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.349693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.352359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.362519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:44.382570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1070/2124] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:44.394973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.396633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:44.436116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1055/2125] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:44 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:44.445163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.472938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:44.555324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091baa-eb65-4b1f-a720-af0df6d8faa9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.559506 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbdaa3-34ca-4983-bd72-ea77eecc4971 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.577588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.578171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.578455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.578726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.582704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.586527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.632576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1056/2126] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:44 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:44.636382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.649642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba839-7d72-4b6b-b605-d1c71a802ca3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.659627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.660167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.660454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.660730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.670408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.671038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.671403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.671680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.673359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.674167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.690995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.695073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.703052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1057/2127] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:44.708079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.722147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1071/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:44.722811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af767-725c-4fc5-89a9-fe30a5de278f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.730682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.731404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.731688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.732585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] PATH_INFO: `/v3/projects/1084e36c5f4143239387cbb98248ec1e/users/95ea384518f74d90ba863ea98ed4b95e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.752314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1084e36c5f4143239387cbb98248ec1e, user_id=95ea384518f74d90ba863ea98ed4b95e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.755047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.771680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1058/2129] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:44 2022] PUT /identity/v3/projects/1084e36c5f4143239387cbb98248ec1e/users/95ea384518f74d90ba863ea98ed4b95e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:44.781214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.794632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8183a-a39f-4ff3-98fe-bfcf6c597c21 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.869471 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac587e4-6983-467e-8d61-4f4258571e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.870738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac587e4-6983-467e-8d61-4f4258571e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.871023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac587e4-6983-467e-8d61-4f4258571e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.871332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac587e4-6983-467e-8d61-4f4258571e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.872035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac587e4-6983-467e-8d61-4f4258571e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.873794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac587e4-6983-467e-8d61-4f4258571e72 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.887789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1072/2130] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:44.888887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:44.904347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21be591-5768-46ae-a1f7-630c927423e7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:44.911413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:44.911413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.911700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.911970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] PATH_INFO: `/v3/projects/1084e36c5f4143239387cbb98248ec1e/users/95ea384518f74d90ba863ea98ed4b95e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.914494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1084e36c5f4143239387cbb98248ec1e, user_id=95ea384518f74d90ba863ea98ed4b95e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:44.918120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:44.929345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1059/2131] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:44 2022] PUT /identity/v3/projects/1084e36c5f4143239387cbb98248ec1e/users/95ea384518f74d90ba863ea98ed4b95e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:44.941440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:44.941440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:44.941863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:44.974481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] MFA Rules not processed for user `95ea384518f74d90ba863ea98ed4b95e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:44.975728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.016037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:45.037367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.039459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.060100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1073/2132] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:45.072354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.073928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.112765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbebae4-bc41-4f79-bebd-006709cf5f89 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.117568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.118206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.118488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.118764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] PATH_INFO: `/v3/projects/607a928b4d2e42d2bfea19e14e6f6f2f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.120000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607a928b4d2e42d2bfea19e14e6f6f2f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.122133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.133976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddd7cf-4e4e-40c5-a9a2-a5e8021688ae None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.137634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148db6e-9ce6-4a4b-a43c-22c5d8606626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.138240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148db6e-9ce6-4a4b-a43c-22c5d8606626 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.138520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148db6e-9ce6-4a4b-a43c-22c5d8606626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.138804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148db6e-9ce6-4a4b-a43c-22c5d8606626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.173630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607a928b4d2e42d2bfea19e14e6f6f2f', 'request_id': 'req-68c51b3a-6c67-4b17-b70c-558c344ca105'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:45.180930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607a928b4d2e42d2bfea19e14e6f6f2f', 'request_id': 'req-68c51b3a-6c67-4b17-b70c-558c344ca105'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:45.188926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607a928b4d2e42d2bfea19e14e6f6f2f', 'request_id': 'req-68c51b3a-6c67-4b17-b70c-558c344ca105'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:45.190587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:45.203873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148db6e-9ce6-4a4b-a43c-22c5d8606626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.205402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148db6e-9ce6-4a4b-a43c-22c5d8606626 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.206019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] The token cache is being invalidate because project 607a928b4d2e42d2bfea19e14e6f6f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:45.206315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:45.206997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-68c51b3a-6c67-4b17-b70c-558c344ca105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:45.208524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1060/2133] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:45 2022] DELETE /identity/v3/projects/607a928b4d2e42d2bfea19e14e6f6f2f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:45.213218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.213506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.214353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.218677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1074/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:45.236627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:45.237836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.298136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1061/2135] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:45.306245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.306669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.306948 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.328805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:45.329865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.339063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1075/2136] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:45.343700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.353812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a7cd7-edb8-4a9d-ae6c-0502aea18f28 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.360425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.361050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.361352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.361639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.362395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:45.362702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.364411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.378539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1062/2137] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:16:45.383454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.393258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ce9d9-077d-4bbc-9c74-c5df9dfb2274 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.398036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.398711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.399055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.399443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.400168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.402509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.441274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1076/2138] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:45 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:16:45.442356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.454191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392f2e6-acc5-45c9-9815-90ec8f55bcf1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.517301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.518001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.518962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.520711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.520711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.521870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.549259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1063/2139] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:45 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:45.553314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.567651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066b77-439e-49e5-ae1e-928308fa1d64 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.572817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.574039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.574389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.574725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.575559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.577700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.602645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1077/2140] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:45.605283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.616178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8013a-7831-420a-a4b1-38914e7eb9e3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.622047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc110f2-e626-42b1-8b5e-d2141d69d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.622739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc110f2-e626-42b1-8b5e-d2141d69d6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.623079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc110f2-e626-42b1-8b5e-d2141d69d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.623440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc110f2-e626-42b1-8b5e-d2141d69d6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.624227 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc110f2-e626-42b1-8b5e-d2141d69d6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.626271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc110f2-e626-42b1-8b5e-d2141d69d6cd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.641880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1064/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:45.645941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.658104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dfc09-135b-4303-8497-ad2bd7f79ce8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.663874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.664678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.665033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.665384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] PATH_INFO: `/v3/projects/3fc6d7d713694eb98fe252597d4aa40e/users/0e4fa8f34f2c4248a53b5d2d31c3c295/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.691770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc6d7d713694eb98fe252597d4aa40e, user_id=0e4fa8f34f2c4248a53b5d2d31c3c295, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.696256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:45.738234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1078/2142] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:45 2022] PUT /identity/v3/projects/3fc6d7d713694eb98fe252597d4aa40e/users/0e4fa8f34f2c4248a53b5d2d31c3c295/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:45.756299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.756685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.756966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.787906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] MFA Rules not processed for user `0e4fa8f34f2c4248a53b5d2d31c3c295`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:45.793549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.868688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:45.895477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1065/2143] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:45.914452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:45.916208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:45.940075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:45.981462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13656f-6255-46dd-8dbb-f96da28da179 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:45.985350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:45.986104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:45.986453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:45.986792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:45.995806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:45.997257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:46.008956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1079/2144] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:46.084607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:46.086131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:46.099484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb935c-cb56-4f70-aa49-a4345ca3c04d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:46.103797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:46.104396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:46.104824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:46.105148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:46.107178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:46.183074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:46.184650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:46.194658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1066/2145] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:46.855840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:46.867346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85e05-f891-4e5b-8e18-d8312cc41d67 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:46.877325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:46.877755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:46.878353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:46.878635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:46.880691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:46.963848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:46.965859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:46.979979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1080/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:50.215228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:50.218434 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:50.228216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae641a4-703d-4f24-a93f-a87f54fe0fc7 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:50.237965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:50.239814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:50.242513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:50.243121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:50.248703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:50.345744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165aa8-f6de-4513-b50d-74f1d16a51ff service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:50.350589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:50.352502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205e630-21e8-4d91-b231-290081c49781 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:50.356291 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:50.356994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:50.357306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:50.357938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] PATH_INFO: `/v3/users/0e4fa8f34f2c4248a53b5d2d31c3c295` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:50.359463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4fa8f34f2c4248a53b5d2d31c3c295)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:50.361843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:50.365544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1081/2147] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:50.513570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4fa8f34f2c4248a53b5d2d31c3c295'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:50.514860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4fa8f34f2c4248a53b5d2d31c3c295'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:50.516470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4fa8f34f2c4248a53b5d2d31c3c295'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:50.530326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4fa8f34f2c4248a53b5d2d31c3c295'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:50.545322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4fa8f34f2c4248a53b5d2d31c3c295'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:50.626097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1067/2148] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:50 2022] DELETE /identity/v3/users/0e4fa8f34f2c4248a53b5d2d31c3c295 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:50.631028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:50.631379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:50.631663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:50.653272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:50.654507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:50.766000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:50.802572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1082/2149] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:50.815525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:50.817308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:50.828858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:50.953613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15e23-7ef3-4cd9-80c9-4b54239fb524 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:50.963221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:50.964219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:50.964559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:50.964887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:50.979250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:50.980977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:50.988805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:50.993562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.003932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e2066-7ff2-4d93-82f3-08411d7626a5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.019264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1068/2150] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:51.020091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.020764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.021045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.021504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] PATH_INFO: `/v3/users/f7f6100716724f508cedd401d3203aa9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.023281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f6100716724f508cedd401d3203aa9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.025728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.106358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f6100716724f508cedd401d3203aa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.107466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f6100716724f508cedd401d3203aa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.108516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f6100716724f508cedd401d3203aa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.127479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f6100716724f508cedd401d3203aa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.141301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f6100716724f508cedd401d3203aa9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.156119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1083/2151] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:50 2022] DELETE /identity/v3/users/f7f6100716724f508cedd401d3203aa9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:51.415499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:51.425810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c18e1-9bf3-4613-8de0-286348e1a696 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.497860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.498705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.499534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:51.500085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.500085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] PATH_INFO: `/v3/projects/7a9f33da4e484b7d822f30f5b889a08d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.501417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9f33da4e484b7d822f30f5b889a08d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.503689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.507208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.528342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cd297-5023-496f-b729-c61bc9d75f14 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.537543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.538199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.538491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.538750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] PATH_INFO: `/v3/projects/3fc6d7d713694eb98fe252597d4aa40e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.539967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc6d7d713694eb98fe252597d4aa40e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.542763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.556635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9f33da4e484b7d822f30f5b889a08d', 'request_id': 'req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.563910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9f33da4e484b7d822f30f5b889a08d', 'request_id': 'req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.570967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9f33da4e484b7d822f30f5b889a08d', 'request_id': 'req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.584359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] The token cache is being invalidate because project 7a9f33da4e484b7d822f30f5b889a08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:51.584622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.585308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.587603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1069/2152] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:51 2022] DELETE /identity/v3/projects/7a9f33da4e484b7d822f30f5b889a08d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:51.593192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:51.594607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.595425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc6d7d713694eb98fe252597d4aa40e', 'request_id': 'req-bb20badf-d139-4392-8d44-338579bda101'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.601563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc6d7d713694eb98fe252597d4aa40e', 'request_id': 'req-bb20badf-d139-4392-8d44-338579bda101'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.608826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc6d7d713694eb98fe252597d4aa40e', 'request_id': 'req-bb20badf-d139-4392-8d44-338579bda101'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.622939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] The token cache is being invalidate because project 3fc6d7d713694eb98fe252597d4aa40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:51.623335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.623950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb20badf-d139-4392-8d44-338579bda101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.625532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1084/2153] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:51 2022] DELETE /identity/v3/projects/3fc6d7d713694eb98fe252597d4aa40e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:51.626710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2266901-fc20-4efe-a68d-fde8eeae534d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.626990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2266901-fc20-4efe-a68d-fde8eeae534d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.627282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2266901-fc20-4efe-a68d-fde8eeae534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.642260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:51.648369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b2266901-fc20-4efe-a68d-fde8eeae534d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:51.650150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b2266901-fc20-4efe-a68d-fde8eeae534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.673489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcaa9c-ce47-4290-aebb-e13eaee44cdd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.694675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:51.715585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1085/2154] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:51.717017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2b35-76c1-41ba-bba5-22cede8167e7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.717307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2b35-76c1-41ba-bba5-22cede8167e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.717583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2b35-76c1-41ba-bba5-22cede8167e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.739788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5ffe2b35-76c1-41ba-bba5-22cede8167e7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:51.740984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5ffe2b35-76c1-41ba-bba5-22cede8167e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.745556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.746197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.746484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.746754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] PATH_INFO: `/v3/users/a25654a37cc547ff80540ade94a09151` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.747946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25654a37cc547ff80540ade94a09151)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.749063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1086/2155] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:51.749980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.750769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe28d9-1cc0-46c4-a9ee-945fc463c279 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.751112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe28d9-1cc0-46c4-a9ee-945fc463c279 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.751657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe28d9-1cc0-46c4-a9ee-945fc463c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.772995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-59fe28d9-1cc0-46c4-a9ee-945fc463c279 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:51.774250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-59fe28d9-1cc0-46c4-a9ee-945fc463c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.783254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1087/2156] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:51.784507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.784787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.785055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.804967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25654a37cc547ff80540ade94a09151'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.805188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:51.805690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25654a37cc547ff80540ade94a09151'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.806222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.806346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25654a37cc547ff80540ade94a09151'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.814355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25654a37cc547ff80540ade94a09151'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.818787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1088/2157] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:51.818787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:51.818787 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.827022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25654a37cc547ff80540ade94a09151'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:51.829630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a3cc-83b7-48e3-bea5-02681fe58bb9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.834252 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.834859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.835142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.835436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.836115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:51.836410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.837988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.851357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1089/2158] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:51.852207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:51.857357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1070/2159] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:51 2022] DELETE /identity/v3/users/a25654a37cc547ff80540ade94a09151 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:51.858192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:51.863710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216795b-c557-4042-8705-fc121e1e3735 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.923532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.923985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed67cbb-bf03-4732-949b-a50cc9a89c08 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:51.924146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.924424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.924694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.925381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:51.925680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.927298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8f3a-765f-4f54-9067-43ea5498fe20 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.928736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:51.929410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.929687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.929958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.930609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:51.932545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:51.939575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1090/2160] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:51.940876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:51.941164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:51.941495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:51.942091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:51.961563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:51.962740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:51.962913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1071/2161] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:51.967525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.023558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1091/2162] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:52.024392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.034852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca2b04-2c69-47b6-a94d-3248177008ef None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.039778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.040404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.040671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5409-76ec-456d-b228-5b5319bcaa0c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.040770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.040942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.042263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.044279 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.046652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.047296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.047575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.047849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.048531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.050449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.070297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1092/2163] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:52 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:52.070297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.070297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:52.089744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1072/2164] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:51 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:52.090464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.122836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:52.154238 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce13b51-1547-446b-8c5b-94038dc0c9da admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.170594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f30aaf-220e-4d93-968f-f57b6626e673 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.179639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.181614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.181959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.182488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.183440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.185203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.198477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1073/2165] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:52.199490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.212720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cd29f-ac2c-4940-b538-678fb29ef159 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.218626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.220427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.220427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.220427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.220727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.222523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.228627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.230498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.230721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.231041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.246162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.248420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.253336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1074/2166] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:52 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:52.254379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.266700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1093/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:52.267948 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.275643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc69c1b-d9fa-432a-a99b-88e8011e9f03 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.279179 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deb484-0341-483c-ad16-34f0824f1203 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.295784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.296911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.297020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.297451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.297782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.298018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.298116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.298542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.299116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.299276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.300990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.302414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.326327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1075/2168] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:52.326515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1094/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:52.328016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.330626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.346284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66365c-928a-4fee-89bc-eb67564a8105 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.349268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c959b-a87c-4fee-9840-b8e942786f1a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.356799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.357513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.358038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.358221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.358947 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.359877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c8ffa-6223-4199-b272-e666785eb76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.360922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c8ffa-6223-4199-b272-e666785eb76d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.361051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.361285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c8ffa-6223-4199-b272-e666785eb76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.361477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c8ffa-6223-4199-b272-e666785eb76d admin admin] PATH_INFO: `/v3/projects/d16a5f67adde47c7a000607fb23d0530/users/b16a98ac368c405f93dc3c21c9d28834/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.374526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1095/2170] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:52.381176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.394658 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c8ffa-6223-4199-b272-e666785eb76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16a5f67adde47c7a000607fb23d0530, user_id=b16a98ac368c405f93dc3c21c9d28834, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.398336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c8ffa-6223-4199-b272-e666785eb76d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.400541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef4826-da04-4ef6-995c-0e269bb7d2b1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.412492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee0d38-7b18-40c8-a03a-3eb23a43631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.413305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee0d38-7b18-40c8-a03a-3eb23a43631e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.415945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee0d38-7b18-40c8-a03a-3eb23a43631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.417182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee0d38-7b18-40c8-a03a-3eb23a43631e admin admin] PATH_INFO: `/v3/projects/b1fec5f30ec4497eb4e04c6f4a202180/users/fcf158775e4048e6889f5c7b54e99706/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.426770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1076/2171] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:52 2022] PUT /identity/v3/projects/d16a5f67adde47c7a000607fb23d0530/users/b16a98ac368c405f93dc3c21c9d28834/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:52.430850 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.433940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.434343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.475784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee0d38-7b18-40c8-a03a-3eb23a43631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fec5f30ec4497eb4e04c6f4a202180, user_id=fcf158775e4048e6889f5c7b54e99706, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.480657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee0d38-7b18-40c8-a03a-3eb23a43631e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.488873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:52.490239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:52.504619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:52.509733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1096/2172] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:52 2022] PUT /identity/v3/projects/b1fec5f30ec4497eb4e04c6f4a202180/users/fcf158775e4048e6889f5c7b54e99706/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:52.516441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.516441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.516677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.550435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:52.551831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:52.610445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1077/2173] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:52.618335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.668215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1097/2174] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:52.681636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.719018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559020d9-8f96-4d69-b555-2a12c953752e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.744467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:52.757422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37333a82-39d0-4d42-89f9-0d895240b801 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.766014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.767728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.769195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.770050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.784909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.786964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.798829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1098/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:52.799668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.800940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:52.801998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.802701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.803049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.803428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.815365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.817313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.817459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a106-88cf-420d-b675-11f166b06014 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:52.824674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:52.825592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:52.826120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:52.826541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] PATH_INFO: `/v3/projects/3df2afdd1ff74f6986597df07f8cb420` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:52.828092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df2afdd1ff74f6986597df07f8cb420)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:52.830280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:52.832859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1078/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:16:52.893417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df2afdd1ff74f6986597df07f8cb420', 'request_id': 'req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:52.900448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df2afdd1ff74f6986597df07f8cb420', 'request_id': 'req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:52.907900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df2afdd1ff74f6986597df07f8cb420', 'request_id': 'req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:52.933781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] The token cache is being invalidate because project 3df2afdd1ff74f6986597df07f8cb420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:52.934388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:52.935414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:52.937029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1099/2177] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:52 2022] DELETE /identity/v3/projects/3df2afdd1ff74f6986597df07f8cb420 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:52.941553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:52.958368 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0374bb8-f758-4968-a3d1-a9785ff6a6e5 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:53.066892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:53.066892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:53.066892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:53.066892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] PATH_INFO: `/v3/users/db2958fa51fc455782dff7480abfc83c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:53.067254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2958fa51fc455782dff7480abfc83c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:53.067254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:53.092804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:53.126088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2958fa51fc455782dff7480abfc83c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.127058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2958fa51fc455782dff7480abfc83c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.127626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2958fa51fc455782dff7480abfc83c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.137046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2958fa51fc455782dff7480abfc83c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.147739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2958fa51fc455782dff7480abfc83c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.176478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1079/2178] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:52 2022] DELETE /identity/v3/users/db2958fa51fc455782dff7480abfc83c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:53.588920 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:53.590479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:53.605507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3f02-e8e8-4504-85b0-39ebf3a2500e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:53.677950 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:53.678926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:53.679095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:53.679370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] PATH_INFO: `/v3/projects/775df477eee74d22a0861891c4dcd6ef` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:53.680526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775df477eee74d22a0861891c4dcd6ef)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:53.682831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:53.753720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775df477eee74d22a0861891c4dcd6ef', 'request_id': 'req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.762412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775df477eee74d22a0861891c4dcd6ef', 'request_id': 'req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.769587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775df477eee74d22a0861891c4dcd6ef', 'request_id': 'req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.782216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:53.799302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] The token cache is being invalidate because project 775df477eee74d22a0861891c4dcd6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:53.799302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.799302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.807611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1100/2179] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:53 2022] DELETE /identity/v3/projects/775df477eee74d22a0861891c4dcd6ef => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:53.809228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:53.812230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:53.825179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea10af-5324-434b-a561-dbfec7ab45d9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:53.884801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:53.885475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:53.885821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:53.886409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] PATH_INFO: `/v3/users/07d227c12fb1400bbc787b53703fde1b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:53.887641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d227c12fb1400bbc787b53703fde1b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:53.889554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:53.939835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d227c12fb1400bbc787b53703fde1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.940497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d227c12fb1400bbc787b53703fde1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.941104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d227c12fb1400bbc787b53703fde1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.950164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d227c12fb1400bbc787b53703fde1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.957478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ba86ce3e-a58e-4006-ac6f-6958a5e90aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d227c12fb1400bbc787b53703fde1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:53.980920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1080/2180] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:53 2022] DELETE /identity/v3/users/07d227c12fb1400bbc787b53703fde1b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:54.380262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:54.381941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:54.398233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b1b9b-b9b7-4ef4-bec6-be5d217d68b2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:54.488309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:54.489301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:54.489686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:54.490060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] PATH_INFO: `/v3/projects/9d79b12eb80b436bbab7aedfd87e8817` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:54.491899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d79b12eb80b436bbab7aedfd87e8817)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:54.494055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:54.590560 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d79b12eb80b436bbab7aedfd87e8817', 'request_id': 'req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:54.598218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d79b12eb80b436bbab7aedfd87e8817', 'request_id': 'req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:54.606099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d79b12eb80b436bbab7aedfd87e8817', 'request_id': 'req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:54.626283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] The token cache is being invalidate because project 9d79b12eb80b436bbab7aedfd87e8817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:54.626808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:54.628052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fc87ff63-29cb-4ff3-a5d6-f5f831cefe4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:54.632288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1101/2181] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:54 2022] DELETE /identity/v3/projects/9d79b12eb80b436bbab7aedfd87e8817 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:54.636918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:54.637207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:54.637482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:54.659119 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:54.659774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:54.671529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:54.792575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1081/2182] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:54.801996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:54.802576 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:54.802996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:54.860732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:54.862188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:54.875090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1102/2183] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:16:54.880040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:54.895045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70cc92-5c9d-4643-80d4-f6a2862d392f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:54.912130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:54.913224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:54.913535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:54.913796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:54.914510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:54.914821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:54.918619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:54.939996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1082/2184] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:54.944616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:54.955508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4cf3-0cb8-4525-bafb-3007c9916050 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:54.964519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:54.965259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:54.965801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:54.966098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:54.967277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:54.969562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:55.009068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1103/2185] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:54 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:55.011306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:55.023183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3919cf-4a2e-4d15-85dc-9b46405b9c6a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:55.121319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:55.122346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:55.122977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:55.123337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:55.124116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:55.126426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:55.160665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1083/2186] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:55 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:55.161009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:55.191646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4808f5-a850-4a69-937a-a85810ea1e7b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:55.199321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:55.199496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:55.199853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:55.200100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:55.200857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:55.202725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:55.219327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1104/2187] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:55.224876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:55.237438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2c62d-22d6-4b32-a8f4-93c55e2efbec admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:55.242786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfd8fd-da17-4ed5-b146-5c7d0b6c06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:55.243528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd8fd-da17-4ed5-b146-5c7d0b6c06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:55.243817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd8fd-da17-4ed5-b146-5c7d0b6c06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:55.244093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd8fd-da17-4ed5-b146-5c7d0b6c06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:55.244824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfd8fd-da17-4ed5-b146-5c7d0b6c06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:55.246463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfd8fd-da17-4ed5-b146-5c7d0b6c06e3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:55.263962 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1084/2188] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:55.268205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:55.280909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ef445-88a7-4115-94db-336aebbaa4ff admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:55.288491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:55.289382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:55.289779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:55.290157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] PATH_INFO: `/v3/projects/537dc263f47c4bde82745f4caeceb2b6/users/e2e1c3179d064773be0fbb06559fdfda/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:55.311412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537dc263f47c4bde82745f4caeceb2b6, user_id=e2e1c3179d064773be0fbb06559fdfda, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:55.316198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:55.347240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1105/2189] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:55 2022] PUT /identity/v3/projects/537dc263f47c4bde82745f4caeceb2b6/users/e2e1c3179d064773be0fbb06559fdfda/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:55.352167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:55.352784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:55.353158 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:55.375740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:55.377212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:55.464979 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1085/2190] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:55.475563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:55.477857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:55.515090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:55.560535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfc94-45ed-4f4c-b3ee-2d978bc00471 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:55.566456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77594de-1077-4ddf-a607-0c530b8248fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:55.567075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77594de-1077-4ddf-a607-0c530b8248fa service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:55.567382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77594de-1077-4ddf-a607-0c530b8248fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:55.567650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77594de-1077-4ddf-a607-0c530b8248fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:55.582258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77594de-1077-4ddf-a607-0c530b8248fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:55.585270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77594de-1077-4ddf-a607-0c530b8248fa service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:55.607378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1106/2191] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:56.107079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:56.108753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:56.156428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a5f0-498e-45a8-86d3-0784940a3286 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:56.201326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:56.202131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:56.203722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:56.204615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] PATH_INFO: `/v3/users/9dab2ea67387445593e776db5a053693` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:56.208368 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dab2ea67387445593e776db5a053693)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:56.210837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:56.254924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:56.327823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dab2ea67387445593e776db5a053693'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:56.328892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dab2ea67387445593e776db5a053693'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:56.329779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dab2ea67387445593e776db5a053693'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:56.341029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dab2ea67387445593e776db5a053693'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:56.354005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dab2ea67387445593e776db5a053693'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:56.398131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1086/2192] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:56 2022] DELETE /identity/v3/users/9dab2ea67387445593e776db5a053693 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:56.399782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661780c2-5224-45ab-856e-e14fa8aa9760 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:56.400371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661780c2-5224-45ab-856e-e14fa8aa9760 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:56.400858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661780c2-5224-45ab-856e-e14fa8aa9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:56.452078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-661780c2-5224-45ab-856e-e14fa8aa9760 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:56.453487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-661780c2-5224-45ab-856e-e14fa8aa9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:56.577455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1107/2193] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:56.622358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:56.628378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:56.730010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4a070-5494-4d78-a289-6b05414c22c0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:56.735283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:56.736390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:56.736885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:56.737565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:56.751616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:56.753901 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:56.767111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1087/2194] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:57.154612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:57.156183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:57.156637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:57.247255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] MFA Rules not processed for user `e2e1c3179d064773be0fbb06559fdfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:57.249483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:57.281245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:57.284636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:57.317540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f04a-593b-449c-b504-60828ef59825 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:57.337041 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:57.337706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:57.337984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:57.338917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] PATH_INFO: `/v3/projects/63b0f9fa96e24a9180fc147e87d36a33` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:57.340060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b0f9fa96e24a9180fc147e87d36a33)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:57.344545 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:57.440983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1108/2195] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:57.460349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b0f9fa96e24a9180fc147e87d36a33', 'request_id': 'req-817db874-e732-4d9e-8f32-c44c27b05f86'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.460505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:57.461910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:57.478554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b0f9fa96e24a9180fc147e87d36a33', 'request_id': 'req-817db874-e732-4d9e-8f32-c44c27b05f86'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.507339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b0f9fa96e24a9180fc147e87d36a33', 'request_id': 'req-817db874-e732-4d9e-8f32-c44c27b05f86'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.539440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] The token cache is being invalidate because project 63b0f9fa96e24a9180fc147e87d36a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:57.539737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.540404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.546649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1088/2196] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:57 2022] DELETE /identity/v3/projects/63b0f9fa96e24a9180fc147e87d36a33 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:16:57.547607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:57.550758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:57.585438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:57.608351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9402-bfee-48b5-a877-d34d7e5b5bfe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:57.637140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:57.649457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817db874-e732-4d9e-8f32-c44c27b05f86 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:57.659269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:57.660134 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:57.660461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:57.660801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] PATH_INFO: `/v3/users/95ea384518f74d90ba863ea98ed4b95e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:57.665487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ea384518f74d90ba863ea98ed4b95e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:57.668561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:57.725182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:57.726036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:57.727429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:57.728346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:57.733048 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:57.781012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ea384518f74d90ba863ea98ed4b95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.781871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ea384518f74d90ba863ea98ed4b95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.783970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ea384518f74d90ba863ea98ed4b95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.802187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ea384518f74d90ba863ea98ed4b95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.815748 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ea384518f74d90ba863ea98ed4b95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:57.877965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1089/2197] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:16:57 2022] DELETE /identity/v3/users/95ea384518f74d90ba863ea98ed4b95e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:57.915696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:57.917284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31d1c5-21c3-4ec8-bf85-34e1d22ad051 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:57.956463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1109/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:16:58.414249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:58.417552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:58.569835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de818a25-4465-4988-a5ef-a3db56bec5e1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:58.576338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:58.576338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:58.576682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:58.577159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] PATH_INFO: `/v3/projects/1084e36c5f4143239387cbb98248ec1e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:58.578691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1084e36c5f4143239387cbb98248ec1e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:58.580955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:58.671845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:58.688224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1084e36c5f4143239387cbb98248ec1e', 'request_id': 'req-d15bb877-7e54-4a99-bdd6-f86025ad13c8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:58.711551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1084e36c5f4143239387cbb98248ec1e', 'request_id': 'req-d15bb877-7e54-4a99-bdd6-f86025ad13c8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:58.719529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1084e36c5f4143239387cbb98248ec1e', 'request_id': 'req-d15bb877-7e54-4a99-bdd6-f86025ad13c8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:58.736785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] The token cache is being invalidate because project 1084e36c5f4143239387cbb98248ec1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:16:58.737087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:58.738566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d15bb877-7e54-4a99-bdd6-f86025ad13c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:16:58.740791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1090/2199] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:16:58 2022] DELETE /identity/v3/projects/1084e36c5f4143239387cbb98248ec1e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:58.749720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:58.750230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:58.750308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:58.778396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:58.780055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:58.890337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1110/2200] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:58.898907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:58.899282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:58.899631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:58.921857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:58.923733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:58.956754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1091/2201] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:58.961338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:58.975928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8139-c7a3-4324-a333-ed75ff55a3d9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:58.988956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:58.989894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:58.990543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:58.991652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:58.993607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:16:58.995306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:59.001453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:59.040061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1111/2202] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:16:59.042417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:59.057267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483189d8-280d-4b62-926b-b956393aabd5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:59.078258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:59.079413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.080508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.081518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.083610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:59.089377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:59.170861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1092/2203] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:16:59 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:59.174659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:59.205601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c480-a7af-4373-b6e1-5c062cea6837 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:59.349519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:59.361354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:59.362535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.364453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.364825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.365685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:59.367976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:59.406481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1112/2204] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:16:59 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:16:59.408003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:59.428613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81db5-570f-4ca3-a8ce-397e43b758ba admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:59.443940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:59.445134 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.445571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.445992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.446922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:59.449721 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:59.469181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1093/2205] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:16:59.472924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:59.490703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd2b6f-c546-45b0-9933-531c5e586d0d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:59.501297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89e25-995e-4fd8-8069-3e1e92dbfaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:59.502260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89e25-995e-4fd8-8069-3e1e92dbfaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.502742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89e25-995e-4fd8-8069-3e1e92dbfaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.503237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89e25-995e-4fd8-8069-3e1e92dbfaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.504124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a89e25-995e-4fd8-8069-3e1e92dbfaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:59.505931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a89e25-995e-4fd8-8069-3e1e92dbfaf2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:59.533335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1113/2206] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:16:59.537202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:59.557000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d355-e969-4e29-b928-93b76ebfc802 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:16:59.570915 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b87f-32ba-4d48-9c16-fbc96ebf861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:16:59.571688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b87f-32ba-4d48-9c16-fbc96ebf861a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.572072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b87f-32ba-4d48-9c16-fbc96ebf861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.574033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b87f-32ba-4d48-9c16-fbc96ebf861a admin admin] PATH_INFO: `/v3/projects/00f8ba665ddf4158bf5593a004512e9c/users/d79c4171953546eab247dc95079c4471/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.608175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5b87f-32ba-4d48-9c16-fbc96ebf861a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f8ba665ddf4158bf5593a004512e9c, user_id=d79c4171953546eab247dc95079c4471, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:16:59.611200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5b87f-32ba-4d48-9c16-fbc96ebf861a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:16:59.646462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1094/2207] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:16:59 2022] PUT /identity/v3/projects/00f8ba665ddf4158bf5593a004512e9c/users/d79c4171953546eab247dc95079c4471/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:16:59.648554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.648961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.649399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.703850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] MFA Rules not processed for user `d79c4171953546eab247dc95079c4471`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:59.705247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:59.724994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:16:59.725286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:16:59.725559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:16:59.764542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] MFA Rules not processed for user `e2e1c3179d064773be0fbb06559fdfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:16:59.768634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:59.907023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1114/2208] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:16:59.915078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:16:59.919666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:16:59.934036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1095/2209] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:16:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:00.080922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26f261-135d-4100-bafd-e21a89b313ca None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:00.085041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48080ba4-2a92-475c-aae0-fbeba4086efe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:00.085665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48080ba4-2a92-475c-aae0-fbeba4086efe service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:00.085949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48080ba4-2a92-475c-aae0-fbeba4086efe service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:00.086216 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48080ba4-2a92-475c-aae0-fbeba4086efe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:00.101851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48080ba4-2a92-475c-aae0-fbeba4086efe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:00.103640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48080ba4-2a92-475c-aae0-fbeba4086efe service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:00.124630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1115/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:16:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:00.880100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:00.881873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:01.035765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddcc34-cd6f-404e-b583-cce9ae6d0523 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:01.050693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:01.051491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:01.051970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:01.052446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] PATH_INFO: `/v3/users/4f2c048a80e940a8ada3d8df0d39089b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:01.055907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2c048a80e940a8ada3d8df0d39089b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:01.062305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:01.107533 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:01.239536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2c048a80e940a8ada3d8df0d39089b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.241329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2c048a80e940a8ada3d8df0d39089b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.241996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2c048a80e940a8ada3d8df0d39089b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.256693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2c048a80e940a8ada3d8df0d39089b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.272561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2c048a80e940a8ada3d8df0d39089b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.316841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1096/2211] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:00 2022] DELETE /identity/v3/users/4f2c048a80e940a8ada3d8df0d39089b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:01.320817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:01.321283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:01.321394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:01.376421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:01.377919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:01.512756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1116/2212] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:01.559415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:01.560892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:01.630114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:01.632775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:01.654099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0330-74c6-473b-b1e9-0eb1c7838e33 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:01.680364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:01.681271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:01.684770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:01.685429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] PATH_INFO: `/v3/users/58ef218a19fe4d3a90027c3f080ecce3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:01.687595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ef218a19fe4d3a90027c3f080ecce3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:01.692383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:01.699608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:01.732966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd8ce2-ec10-433b-ae62-b4aa236445e2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:01.744591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4915470-3aeb-4fee-9739-397a39e41b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:01.745835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4915470-3aeb-4fee-9739-397a39e41b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:01.746618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4915470-3aeb-4fee-9739-397a39e41b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:01.747562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4915470-3aeb-4fee-9739-397a39e41b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:01.771806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4915470-3aeb-4fee-9739-397a39e41b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:01.779387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4915470-3aeb-4fee-9739-397a39e41b4c service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:01.814180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1097/2213] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:01.819976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ef218a19fe4d3a90027c3f080ecce3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.821293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ef218a19fe4d3a90027c3f080ecce3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.823766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ef218a19fe4d3a90027c3f080ecce3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.857615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ef218a19fe4d3a90027c3f080ecce3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.883404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ef218a19fe4d3a90027c3f080ecce3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:01.905955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1117/2214] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:01 2022] DELETE /identity/v3/users/58ef218a19fe4d3a90027c3f080ecce3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:01.910632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476f92-e482-4d90-b231-23cf19a6ae34 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:01.911220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476f92-e482-4d90-b231-23cf19a6ae34 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:01.911220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91476f92-e482-4d90-b231-23cf19a6ae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:01.990245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-91476f92-e482-4d90-b231-23cf19a6ae34 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:01.992175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-91476f92-e482-4d90-b231-23cf19a6ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:02.129085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1098/2215] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:02.156339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:02.161393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:02.285568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714f2c-7826-404a-b633-7f3b45ba009a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:02.289866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:02.290771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:02.292150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:02.292919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:02.307845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:02.309742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:02.324692 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1118/2216] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:02.734238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:02.734532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:02.734813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:02.833983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] MFA Rules not processed for user `b16a98ac368c405f93dc3c21c9d28834`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:02.836586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:02.890475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:03.000872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1099/2217] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:03.021438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:03.023897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:03.245122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:03.247556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:03.287378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bf7e8-e93f-45e9-922c-cdad3328a346 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:03.295540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:03.296438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:03.296734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:03.297099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:03.297733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b9b9-2bcb-4ffb-b13c-18f7335cd236 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:03.307146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:03.309009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:03.314732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:03.316398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:03.316892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:03.317327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] PATH_INFO: `/v3/projects/6c4c2f75b7dd41189ab3f4202f33bd07` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:03.321273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4c2f75b7dd41189ab3f4202f33bd07)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:03.321827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1119/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:03.325103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:03.444381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:03.446462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:03.509495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d22a3-71c3-48b8-8bba-16515ce38df3 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:03.531135 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:03.546101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4c2f75b7dd41189ab3f4202f33bd07', 'request_id': 'req-a97857c7-10fa-4689-b42f-47c7bde6fb16'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.553411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4c2f75b7dd41189ab3f4202f33bd07', 'request_id': 'req-a97857c7-10fa-4689-b42f-47c7bde6fb16'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.563817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4c2f75b7dd41189ab3f4202f33bd07', 'request_id': 'req-a97857c7-10fa-4689-b42f-47c7bde6fb16'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.597075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] The token cache is being invalidate because project 6c4c2f75b7dd41189ab3f4202f33bd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:03.598832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.601007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.602966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1100/2219] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:03 2022] DELETE /identity/v3/projects/6c4c2f75b7dd41189ab3f4202f33bd07 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:03.611521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:03.628559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:03.727684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:03.729390 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:03.731285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:03.734569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] PATH_INFO: `/v3/projects/914b1beaee7f4531a7f920842b79fccc` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:03.736936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914b1beaee7f4531a7f920842b79fccc)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:03.740446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:03.860989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97857c7-10fa-4689-b42f-47c7bde6fb16 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:03.891753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914b1beaee7f4531a7f920842b79fccc', 'request_id': 'req-3d0fc698-df76-47eb-be77-6c11d564e368'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.921932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914b1beaee7f4531a7f920842b79fccc', 'request_id': 'req-3d0fc698-df76-47eb-be77-6c11d564e368'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.937152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914b1beaee7f4531a7f920842b79fccc', 'request_id': 'req-3d0fc698-df76-47eb-be77-6c11d564e368'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.963334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] The token cache is being invalidate because project 914b1beaee7f4531a7f920842b79fccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:03.963797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.964575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d0fc698-df76-47eb-be77-6c11d564e368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:03.968946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1120/2220] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:03 2022] DELETE /identity/v3/projects/914b1beaee7f4531a7f920842b79fccc => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:03.973793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2eb03-3e90-4314-b26e-daf4c5d8ff65 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:03.974083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2eb03-3e90-4314-b26e-daf4c5d8ff65 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:03.974363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2eb03-3e90-4314-b26e-daf4c5d8ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:03.976059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:03.997478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:03.998155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:03.998428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:03.998964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] PATH_INFO: `/v3/users/dcb8e12750b14ccaa0ca2536ed4f1fff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.000953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb8e12750b14ccaa0ca2536ed4f1fff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:04.005805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:04.019378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-06d2eb03-3e90-4314-b26e-daf4c5d8ff65 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:04.035639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06d2eb03-3e90-4314-b26e-daf4c5d8ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:04.079763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1121/2221] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:04.086823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.087368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.089065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.134104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb8e12750b14ccaa0ca2536ed4f1fff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:04.142297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb8e12750b14ccaa0ca2536ed4f1fff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:04.144264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb8e12750b14ccaa0ca2536ed4f1fff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:04.157702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:04.160047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:04.162816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb8e12750b14ccaa0ca2536ed4f1fff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:04.183096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb8e12750b14ccaa0ca2536ed4f1fff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:04.195592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1122/2222] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:04.199659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:04.231210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46fbe3-cea8-4fed-ae59-548b5d781dba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:04.237597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1101/2223] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:03 2022] DELETE /identity/v3/users/dcb8e12750b14ccaa0ca2536ed4f1fff => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:04.243914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:04.245504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.245834 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.246108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.247066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:04.247441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:04.249328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:04.268530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1123/2224] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:17:04.272943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:04.424077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dbae-c93f-4b39-b416-48168c889278 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:04.433413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:04.434349 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.434964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.436538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.437601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:04.449571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:04.505793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1102/2225] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:04 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:04.508101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:04.523808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1d50-e94f-436f-9349-24291c79b8c0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:04.768153 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bfff-e3ec-4343-a7cf-06e21cc141bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:04.769128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bfff-e3ec-4343-a7cf-06e21cc141bf admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.769618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bfff-e3ec-4343-a7cf-06e21cc141bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.770039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bfff-e3ec-4343-a7cf-06e21cc141bf admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.771108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bfff-e3ec-4343-a7cf-06e21cc141bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:04.790370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bfff-e3ec-4343-a7cf-06e21cc141bf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:04.853743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1124/2226] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:04 2022] POST /identity/v3/users => generated 281 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:04.858769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:04.874417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436467d-9991-4f61-992c-8abe9cc18219 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:04.890705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.891091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.891397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.896413 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:04.899350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:04.907187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.909642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.909642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.910136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:04.912025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:04.932834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1103/2227] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:04.941187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:04.950138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] MFA Rules not processed for user `fcf158775e4048e6889f5c7b54e99706`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:04.950866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:04.979988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda554ee-42a5-4fdb-9872-7cc258b5d525 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:04.987965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:04.989042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:04.990600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:04.991149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:04.992114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:04.997218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.059573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1104/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:05.062663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.098787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af113-9e3c-4ca4-ac99-ff3361929292 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.101577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1125/2229] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:05.102719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.105210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:05.110162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83fe6c-fdcf-4362-bb68-a089d3dff963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.111187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83fe6c-fdcf-4362-bb68-a089d3dff963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.111757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83fe6c-fdcf-4362-bb68-a089d3dff963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.112278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83fe6c-fdcf-4362-bb68-a089d3dff963 admin admin] PATH_INFO: `/v3/projects/f0039e40e6a74607beab1bd50e1deacb/users/1595cefaaaf041818ac2e875690c7d69/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.131723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53612afe-1d2c-4355-bcab-b930e242f77d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.135431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83fe6c-fdcf-4362-bb68-a089d3dff963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0039e40e6a74607beab1bd50e1deacb, user_id=1595cefaaaf041818ac2e875690c7d69, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.137626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.138253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.138575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.138840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.139708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.140974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83fe6c-fdcf-4362-bb68-a089d3dff963 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.142025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.189785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1105/2230] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:05 2022] PUT /identity/v3/projects/f0039e40e6a74607beab1bd50e1deacb/users/1595cefaaaf041818ac2e875690c7d69/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:05.206262 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.206808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.207940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.231014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1126/2231] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:05 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:05.232218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.247798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:05.263759 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] MFA Rules not processed for user `1595cefaaaf041818ac2e875690c7d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:05.265697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:05.372839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1106/2232] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:05.414897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.418689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:05.438431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae02013-843f-4434-ba4e-754ec01f67c6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.445453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.446088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.446372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.446647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.447915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.450353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.483022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1127/2233] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:05 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:05.500467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.519751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a713558-5dde-45cf-b405-8506a2ded558 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.539700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.540436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.542285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.542642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.543449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.545922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.550672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c216a9-1654-49c2-9d55-59dd1cccfea2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.555428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.556802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.558346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.558823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.571289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1128/2234] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:05.576025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.576258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.577698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.591697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1107/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:05.616768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.630934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a45adf-46d3-4f2e-a9e3-9bb00f4dae8a service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.631232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150bce7-4f9a-491f-8f5b-370bd6e300c0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.638660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.638941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:05.639796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.640056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.640332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] PATH_INFO: `/v3/users/1595cefaaaf041818ac2e875690c7d69` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.641040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.641632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.642050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] PATH_INFO: `/v3/projects/5b5e9afa46c6401288cb3e747e03e8d8/users/c043ad0f840e4ce2b4ec36a0425f560f/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.642176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1595cefaaaf041818ac2e875690c7d69)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.644817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.664485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5e9afa46c6401288cb3e747e03e8d8, user_id=c043ad0f840e4ce2b4ec36a0425f560f, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:05.668758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:05.702977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1129/2236] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:05 2022] PUT /identity/v3/projects/5b5e9afa46c6401288cb3e747e03e8d8/users/c043ad0f840e4ce2b4ec36a0425f560f/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:05.704084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:05.761102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1595cefaaaf041818ac2e875690c7d69'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:05.763060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1595cefaaaf041818ac2e875690c7d69'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:05.763775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:05.765587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1595cefaaaf041818ac2e875690c7d69'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:05.785099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1595cefaaaf041818ac2e875690c7d69'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:05.802546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ef7954e6-e4cd-47f7-80ab-879a7c5224b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1595cefaaaf041818ac2e875690c7d69'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:05.844404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1108/2237] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:05 2022] DELETE /identity/v3/users/1595cefaaaf041818ac2e875690c7d69 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:05.846219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:05.846847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:05.847595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:05.892230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:05.893698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:05.895688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5050-b202-4962-b977-81e271b5f0bb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:05.906440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:06.000215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1109/2238] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:06.022263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:06.025887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:06.065672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:06.066186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.066573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.066949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.067780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:06.075217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:06.092134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1130/2239] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:06.098315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:06.101527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:06.124487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722b4db-f621-4d5d-9719-8e648a3471ab None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:06.127841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484dceb-3d03-4efa-a4e3-4c481cc35ac0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:06.137879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:06.138657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.139201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.139493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.150182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb172601-dac0-4d55-bf94-2d8adefc33c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:06.151143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb172601-dac0-4d55-bf94-2d8adefc33c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.151620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb172601-dac0-4d55-bf94-2d8adefc33c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.151906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb172601-dac0-4d55-bf94-2d8adefc33c6 admin admin] PATH_INFO: `/v3/projects/5b5e9afa46c6401288cb3e747e03e8d8/users/c043ad0f840e4ce2b4ec36a0425f560f/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.154788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:06.156270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:06.161017 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb172601-dac0-4d55-bf94-2d8adefc33c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5e9afa46c6401288cb3e747e03e8d8, user_id=c043ad0f840e4ce2b4ec36a0425f560f, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:06.165225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb172601-dac0-4d55-bf94-2d8adefc33c6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:06.185218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1110/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:06.186515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:06.188071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:06.205670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1131/2241] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:06 2022] PUT /identity/v3/projects/5b5e9afa46c6401288cb3e747e03e8d8/users/c043ad0f840e4ce2b4ec36a0425f560f/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:06.214767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5337dd-c8cf-46e4-9f51-c95225626b6c service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:06.346892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:06.346892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.348995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.351638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] PATH_INFO: `/v3/projects/e8e3e96f2c724bfa962bbfd109a143b1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.353940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e3e96f2c724bfa962bbfd109a143b1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:06.356380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:06.450814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e3e96f2c724bfa962bbfd109a143b1', 'request_id': 'req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:06.460224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e3e96f2c724bfa962bbfd109a143b1', 'request_id': 'req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:06.465967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:06.473997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e3e96f2c724bfa962bbfd109a143b1', 'request_id': 'req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:06.505272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] The token cache is being invalidate because project e8e3e96f2c724bfa962bbfd109a143b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:06.506409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:06.507139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f6cc8385-ae8b-4b82-afa2-bbb647e6c81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:06.511435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1111/2242] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:06 2022] DELETE /identity/v3/projects/e8e3e96f2c724bfa962bbfd109a143b1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:06.516306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.516597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.516875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.576346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:06.577498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:06.753387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1132/2243] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:06.763912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.764677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.764677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.811419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:06.819379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:06.835181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1112/2244] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:06.840236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:06.854495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7cc3b-36ee-45e8-b580-7e4e3f0846d1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:06.870195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:06.871246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.871749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.872177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.873151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:06.873625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:06.875473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:06.912721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1133/2245] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:17:06.914296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:06.931084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d40e3-79d7-4f3f-9ae1-af2fcf69e311 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:06.943964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a532417-c6fa-41f4-960d-87fb89955067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:06.946294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532417-c6fa-41f4-960d-87fb89955067 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:06.946294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532417-c6fa-41f4-960d-87fb89955067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:06.946294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a532417-c6fa-41f4-960d-87fb89955067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:06.946294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a532417-c6fa-41f4-960d-87fb89955067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:06.949133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a532417-c6fa-41f4-960d-87fb89955067 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:07.006540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1113/2246] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:06 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:07.011927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:07.032788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316ae97-89d7-4084-b277-c4fdd0be5600 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:07.142438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:07.142965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:07.142965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:07.147010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:07.182834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] MFA Rules not processed for user `b16a98ac368c405f93dc3c21c9d28834`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:07.184045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:07.211801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:07.212541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:07.213969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:07.214930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:07.217335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:07.221440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:07.277849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1134/2247] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:07 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:07.282427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:07.302583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42126-8a69-41da-8268-9df7de4fa0b1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:07.316512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:07.317137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:07.317416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:07.317691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:07.318510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:07.320908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:07.348634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1135/2248] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:07.355779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:07.377775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c8d1-190d-409a-80fb-21825e9bfd6a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:07.393076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925601b-5d9e-45c0-9c15-0cb04715211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:07.393726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925601b-5d9e-45c0-9c15-0cb04715211c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:07.394003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925601b-5d9e-45c0-9c15-0cb04715211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:07.394273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925601b-5d9e-45c0-9c15-0cb04715211c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:07.395350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925601b-5d9e-45c0-9c15-0cb04715211c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:07.399181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925601b-5d9e-45c0-9c15-0cb04715211c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:07.407083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1114/2249] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:07.421524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1136/2250] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:07.426223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:07.461852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78990ee7-c3e3-4dab-b052-1539a848abcf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:07.513535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:07.517325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:07.517623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:07.517910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] PATH_INFO: `/v3/projects/dda394440df94053a36df87d235dd5d5/users/b3c863cf1fe14bfeb4b9465cbec48a23/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:07.568248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda394440df94053a36df87d235dd5d5, user_id=b3c863cf1fe14bfeb4b9465cbec48a23, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:07.573722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:07.599663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1115/2251] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:07 2022] PUT /identity/v3/projects/dda394440df94053a36df87d235dd5d5/users/b3c863cf1fe14bfeb4b9465cbec48a23/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:07.621318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:07.622995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:07.623469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:07.706127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] MFA Rules not processed for user `b3c863cf1fe14bfeb4b9465cbec48a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:07.709836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:07.913897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1137/2252] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:07.917156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:07.955702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:07.958431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:08.133527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e914b-4a90-4a91-8972-6677bf3bf9dc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.136657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c1937-7216-4c52-99d8-7427d0cad0df None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.149752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.153151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.157482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.159514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.160046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.160674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.162664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] PATH_INFO: `/v3/projects/f0039e40e6a74607beab1bd50e1deacb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.162870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.164312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:08.167149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0039e40e6a74607beab1bd50e1deacb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:08.178133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:08.182633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:08.309869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1116/2253] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:07 2022] POST /identity/v3/projects => generated 387 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:08.314881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:08.379592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:08.395099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0039e40e6a74607beab1bd50e1deacb', 'request_id': 'req-42d6831e-bd57-4f4e-9410-0b1c57c07471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:08.412284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0039e40e6a74607beab1bd50e1deacb', 'request_id': 'req-42d6831e-bd57-4f4e-9410-0b1c57c07471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:08.418572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:08.433838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0039e40e6a74607beab1bd50e1deacb', 'request_id': 'req-42d6831e-bd57-4f4e-9410-0b1c57c07471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:08.464841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] The token cache is being invalidate because project f0039e40e6a74607beab1bd50e1deacb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:08.465119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:08.467733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-42d6831e-bd57-4f4e-9410-0b1c57c07471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:08.470713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1138/2254] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:07 2022] DELETE /identity/v3/projects/f0039e40e6a74607beab1bd50e1deacb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:08.478101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d339a-848d-49d7-b60b-5079f4ad164d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.479087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d339a-848d-49d7-b60b-5079f4ad164d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.479888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d339a-848d-49d7-b60b-5079f4ad164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.524783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59056c68-a990-40f4-b085-338904354f62 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.536875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4d6d339a-848d-49d7-b60b-5079f4ad164d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:08.538611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4d6d339a-848d-49d7-b60b-5079f4ad164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:08.655784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.656637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.656987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.657446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.658340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:08.670595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:08.673292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1139/2255] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:08.680699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.680987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.681293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.764941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1117/2256] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:08 2022] POST /identity/v3/users => generated 300 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:08.765095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:08.774034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:08.779018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:08.780277 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:08.798410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1140/2257] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:08.800272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932d9ac-0d1c-40e6-a208-4d780b2a2660 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.811207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:08.841640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.842407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.842585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.842816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.843562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:08.858269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:08.860581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d5662-550a-4828-b047-9c23f9f589ae None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.899040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.899671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.899954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.900398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.901653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:08.901958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:08.903643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:08.923567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1118/2258] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:08.926223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:08.932100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1141/2259] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:17:08.938112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:08.963231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89b72c-a518-4130-9c70-e3e270dfdfcc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.965604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555cf1-c8b1-4468-9802-0e50eb6a611d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:08.978771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.981386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:08.981739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.982068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:08.982171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.982372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:08.982656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.983352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:08.983586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] PATH_INFO: `/v3/projects/7dc00db534394b599bcb1b0247d93299/users/8304bfd16c4a4b58bb7c9bf356c36dcc/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:08.985279 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.026729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc00db534394b599bcb1b0247d93299, user_id=8304bfd16c4a4b58bb7c9bf356c36dcc, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.033576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.062837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1142/2261] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:08 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:17:09.063141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1119/2261] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:08 2022] PUT /identity/v3/projects/7dc00db534394b599bcb1b0247d93299/users/8304bfd16c4a4b58bb7c9bf356c36dcc/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:09.067249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.069957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.298021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70eb4-0abb-4ada-8bee-27cfd99a0c16 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:09.312969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:09.313606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.313889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.314159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.314861 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.321059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.331580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dead7-2274-484d-8546-7d92e8a1a974 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:09.348353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:09.348990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.349270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.351390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.354085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.366199 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1143/2262] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:09.367379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.368177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.406361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adade0-3996-440a-8ddb-428b110f054d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:09.427076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b3ca-17f4-4555-9eb9-50e4a81b5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:09.427833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b3ca-17f4-4555-9eb9-50e4a81b5c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.428152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b3ca-17f4-4555-9eb9-50e4a81b5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.428429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b3ca-17f4-4555-9eb9-50e4a81b5c31 admin admin] PATH_INFO: `/v3/projects/7dc00db534394b599bcb1b0247d93299/users/8304bfd16c4a4b58bb7c9bf356c36dcc/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.438329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4b3ca-17f4-4555-9eb9-50e4a81b5c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc00db534394b599bcb1b0247d93299, user_id=8304bfd16c4a4b58bb7c9bf356c36dcc, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.454542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1120/2263] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:09 2022] POST /identity/v3/users => generated 288 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:09.454774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4b3ca-17f4-4555-9eb9-50e4a81b5c31 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.459042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.524000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1144/2264] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:09 2022] PUT /identity/v3/projects/7dc00db534394b599bcb1b0247d93299/users/8304bfd16c4a4b58bb7c9bf356c36dcc/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:09.524797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f79ab-4a59-45d1-b217-bf00009102e8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:09.526364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.526652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.526944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.582833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:09.616054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:09.651586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] MFA Rules not processed for user `8304bfd16c4a4b58bb7c9bf356c36dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:09.653187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:09.712139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:09.713672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.714241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.714724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.717017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.719015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.743513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1121/2265] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:09.745145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.756170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1f38-ff48-4a93-9eff-7fd748407adb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:09.761350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:09.762022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.762314 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.762587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.765248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.767400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.786506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1122/2266] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:09.790543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.808251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1145/2267] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:09.816217 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acaeda-f3ac-4d98-96cd-bf2901e2de6e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:09.823025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357b5e-476b-47b6-9293-6c30673c6603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:09.824591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357b5e-476b-47b6-9293-6c30673c6603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.825128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357b5e-476b-47b6-9293-6c30673c6603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.825895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357b5e-476b-47b6-9293-6c30673c6603 admin admin] PATH_INFO: `/v3/projects/bd3660c13a2d4f1dbd474a2f8a775511/users/5151642a99104a2ebb69a9e776064610/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:09.834734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:09.860753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:09.895802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357b5e-476b-47b6-9293-6c30673c6603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3660c13a2d4f1dbd474a2f8a775511, user_id=5151642a99104a2ebb69a9e776064610, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:09.929518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357b5e-476b-47b6-9293-6c30673c6603 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:09.973107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1123/2268] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:09 2022] PUT /identity/v3/projects/bd3660c13a2d4f1dbd474a2f8a775511/users/5151642a99104a2ebb69a9e776064610/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:09.985672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:09.986176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:09.986642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:10.079505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9c8f1-1f91-43ba-bc8a-ea5f04cc7dfc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:10.112108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] MFA Rules not processed for user `5151642a99104a2ebb69a9e776064610`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:10.113775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:10.252304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:10.252938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:10.253228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:10.253539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:10.290419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1124/2269] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:10.294781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:10.462445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:10.464219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:10.476377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56ee8-7651-4aac-818a-6c5bee3a8792 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:10.504250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:10.504893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:10.505179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:10.505457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:10.506142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:10.506641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1146/2270] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:10.510554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:10.539816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:10.578436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1125/2271] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:10 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:17:10.582681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:10.589673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:10.601586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc20b5-68c0-4fb5-b494-f5e3b6dce0ec service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:10.864688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:10.865391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:10.865840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:10.865971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:10.866793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:10.868697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:10.941415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1147/2272] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:10 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:10.945796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:10.959659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c973-5ade-481a-8ba4-b01a449d0e68 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:10.986284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:10.987433 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:10.987755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:10.988538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:10.988756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:10.990569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:11.023104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1126/2273] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:11.024601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:11.073204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ba534-4812-4247-998c-7850ef11343b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:11.078989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04c208-fee0-4bbd-82cf-bf0de8ca1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:11.079782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c208-fee0-4bbd-82cf-bf0de8ca1a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:11.080151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c208-fee0-4bbd-82cf-bf0de8ca1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:11.080712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c208-fee0-4bbd-82cf-bf0de8ca1a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:11.081548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04c208-fee0-4bbd-82cf-bf0de8ca1a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:11.083453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04c208-fee0-4bbd-82cf-bf0de8ca1a75 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:11.100759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1148/2274] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:11.106624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:11.127070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806562a-a150-4c40-978c-48ffb508cb8a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:11.136015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:11.137478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:11.139091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:11.139764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] PATH_INFO: `/v3/projects/bcaeac7d65244a8fa0159e8e796987ee/users/6adb3841747e4e9fba9737de07aad8ff/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:11.180608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcaeac7d65244a8fa0159e8e796987ee, user_id=6adb3841747e4e9fba9737de07aad8ff, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:11.185899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:11.245374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1127/2275] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:11 2022] PUT /identity/v3/projects/bcaeac7d65244a8fa0159e8e796987ee/users/6adb3841747e4e9fba9737de07aad8ff/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:11.257896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:11.258294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:11.258558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:11.362122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] MFA Rules not processed for user `6adb3841747e4e9fba9737de07aad8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:11.364091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:11.614075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1149/2276] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:11.615002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:11.796466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcbcb6-dc20-4a38-851f-7e66c8997920 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:11.801203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:11.803476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:11.803811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:11.804324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:11.805124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:11.808332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:11.857513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:11.859233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1128/2277] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:11 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:11.871194 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe1f7-f784-44e1-80e1-1ead2f3a1418 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.017988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.022234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.022990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.023871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.024306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.025836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.027976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.035056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6c40e-afde-4884-a562-b29c9dfc5532 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.045043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.045737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.046023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.046326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] PATH_INFO: `/v3/users/b3c863cf1fe14bfeb4b9465cbec48a23` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.057446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:12.059477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c863cf1fe14bfeb4b9465cbec48a23)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.062112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.076468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1150/2278] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:11 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:17:12.078291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.115589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c920b-184a-44bc-a979-5610b676c23a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.133811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.138079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.138400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.138768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.139750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.146959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.187702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1151/2279] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:12.191811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c863cf1fe14bfeb4b9465cbec48a23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:12.192755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.193385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c863cf1fe14bfeb4b9465cbec48a23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:12.194708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c863cf1fe14bfeb4b9465cbec48a23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:12.201272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:12.225622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533e975-6214-4f29-9f71-7ee07d0905f0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.234448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c863cf1fe14bfeb4b9465cbec48a23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:12.239880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.242038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.245913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.246492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] PATH_INFO: `/v3/projects/293390f231764124a6c5ead5dfd29770/users/7e2ead8616544eb9b28cb085a2e5e4bd/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.247166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6376f9b0-5f4d-492e-89fd-3151b3a58576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c863cf1fe14bfeb4b9465cbec48a23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:12.280490 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293390f231764124a6c5ead5dfd29770, user_id=7e2ead8616544eb9b28cb085a2e5e4bd, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.286128 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.289865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1129/2280] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:12 2022] DELETE /identity/v3/users/b3c863cf1fe14bfeb4b9465cbec48a23 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:12.295109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.295551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.295920 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.327751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1152/2281] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:12 2022] PUT /identity/v3/projects/293390f231764124a6c5ead5dfd29770/users/7e2ead8616544eb9b28cb085a2e5e4bd/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:12.333293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.345228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:12.347056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:12.361300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:12.478889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e78b-ea0a-4a40-87af-d599a03ea7c9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.487222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.488491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.489161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.489670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.492112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.495393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.510378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1153/2282] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:12.514272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.525795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1130/2283] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:12.529357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd01cc-50e7-49f1-8afa-d9307545305b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.546315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a964-c186-4051-9ad2-7254f14eaa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.547030 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a964-c186-4051-9ad2-7254f14eaa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.547546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a964-c186-4051-9ad2-7254f14eaa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.548136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a964-c186-4051-9ad2-7254f14eaa0e admin admin] PATH_INFO: `/v3/projects/293390f231764124a6c5ead5dfd29770/users/7e2ead8616544eb9b28cb085a2e5e4bd/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.551647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246a964-c186-4051-9ad2-7254f14eaa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=293390f231764124a6c5ead5dfd29770, user_id=7e2ead8616544eb9b28cb085a2e5e4bd, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.554498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246a964-c186-4051-9ad2-7254f14eaa0e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.581758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.588544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:12.593043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1154/2284] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:12 2022] PUT /identity/v3/projects/293390f231764124a6c5ead5dfd29770/users/7e2ead8616544eb9b28cb085a2e5e4bd/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:12.604579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.604936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.605417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.682809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] MFA Rules not processed for user `7e2ead8616544eb9b28cb085a2e5e4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:12.685983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:12.727273 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c5ff-a23c-4faa-84b2-e5755370d34a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.800524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.801091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.802537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.802821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.827134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1155/2285] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:12.857334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:12.863393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:12.917900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:12.919843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:12.935964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1131/2286] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:12.939188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:12.980557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c260-f3f9-4954-a64b-86177419b637 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:12.985876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:12.986880 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:12.987184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:12.987475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:12.989767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:13.093058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:13.094600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:13.108908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1156/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:14.022456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:14.025443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:14.044128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c27dec-5f7e-4637-8457-448f1084d517 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:14.048836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:14.049602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:14.049884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:14.050160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] PATH_INFO: `/v3/projects/dda394440df94053a36df87d235dd5d5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:14.051343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda394440df94053a36df87d235dd5d5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:14.053379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:14.071700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:14.123734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda394440df94053a36df87d235dd5d5', 'request_id': 'req-6a45b717-90a5-4c72-a960-a773f00871b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.130949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda394440df94053a36df87d235dd5d5', 'request_id': 'req-6a45b717-90a5-4c72-a960-a773f00871b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.141559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda394440df94053a36df87d235dd5d5', 'request_id': 'req-6a45b717-90a5-4c72-a960-a773f00871b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.160559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] The token cache is being invalidate because project dda394440df94053a36df87d235dd5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:14.160940 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.161648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.167012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1132/2288] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:14 2022] DELETE /identity/v3/projects/dda394440df94053a36df87d235dd5d5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:14.168144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:14.188294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30288-3fe5-44df-b0c7-d4d1b9d63f2f service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:14.283414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:14.285123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:14.285663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:14.286386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] PATH_INFO: `/v3/users/8304bfd16c4a4b58bb7c9bf356c36dcc` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:14.288065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8304bfd16c4a4b58bb7c9bf356c36dcc)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:14.293802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:14.360456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8304bfd16c4a4b58bb7c9bf356c36dcc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.361178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8304bfd16c4a4b58bb7c9bf356c36dcc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.361786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8304bfd16c4a4b58bb7c9bf356c36dcc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.376448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8304bfd16c4a4b58bb7c9bf356c36dcc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.396768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8304bfd16c4a4b58bb7c9bf356c36dcc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:14.414410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1157/2289] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:14 2022] DELETE /identity/v3/users/8304bfd16c4a4b58bb7c9bf356c36dcc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:14.822813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:14.825322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:14.848121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b717-90a5-4c72-a960-a773f00871b2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:14.936590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:14.937788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:14.938196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:14.938569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] PATH_INFO: `/v3/projects/7dc00db534394b599bcb1b0247d93299` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:14.940415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc00db534394b599bcb1b0247d93299)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:14.942799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:15.039997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:15.042508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:15.053774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:15.054171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc00db534394b599bcb1b0247d93299', 'request_id': 'req-f732eba5-a1d8-431c-9464-5484d46d6e6f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:15.069555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc00db534394b599bcb1b0247d93299', 'request_id': 'req-f732eba5-a1d8-431c-9464-5484d46d6e6f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:15.082336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc00db534394b599bcb1b0247d93299', 'request_id': 'req-f732eba5-a1d8-431c-9464-5484d46d6e6f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:15.120172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] The token cache is being invalidate because project 7dc00db534394b599bcb1b0247d93299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:15.120172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:15.120559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f732eba5-a1d8-431c-9464-5484d46d6e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:15.122987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1133/2290] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:14 2022] DELETE /identity/v3/projects/7dc00db534394b599bcb1b0247d93299 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:15.127959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec6b1-f3cd-4109-8846-555de161e354 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.128494 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec6b1-f3cd-4109-8846-555de161e354 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.128980 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec6b1-f3cd-4109-8846-555de161e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.159694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1ceec6b1-f3cd-4109-8846-555de161e354 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:15.163199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1ceec6b1-f3cd-4109-8846-555de161e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:15.236563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cff1f6-16dd-4d1f-8c66-69dd517d30e1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:15.263438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:15.339229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:15.340075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.340478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.340828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.343776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:15.367753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1134/2291] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:15.372448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.376037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.376492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.440475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:15.443458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:15.474355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:15.476339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:15.480235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1135/2292] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:15.481505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:15.493028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1158/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:17:15.503768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c59a9-7e7f-4e87-829b-13d1ff3de82e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:15.510517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:15.511402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.511785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.512163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.512974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:15.513382 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:15.516172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:15.564257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1136/2294] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:17:15.568896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:15.588499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1e0fd-ba1d-4236-a776-b5c69b1f41c3 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:15.602060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:15.605429 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.605717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.606592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.608873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:15.615508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:15.686678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1159/2295] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:15 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:15.692370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:15.719286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902266-55ee-43eb-87f0-54d4ef5a8b83 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:15.872597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:15.873528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.873683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.874417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.875398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:15.877770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:15.924542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1137/2296] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:15 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:15.928243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:15.950157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e205c4a-3ad6-4cfb-8330-e89242814e85 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:15.957400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:15.958608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:15.958968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:15.959590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:15.961054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:15.963650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:15.986807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1160/2297] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:15.988145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:16.021427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328399f-091d-422f-a8f3-08f3f33e9c53 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:16.044372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991927b3-2965-4485-9a49-7f9d97831364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:16.045436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991927b3-2965-4485-9a49-7f9d97831364 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:16.046259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991927b3-2965-4485-9a49-7f9d97831364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:16.046750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991927b3-2965-4485-9a49-7f9d97831364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:16.052042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991927b3-2965-4485-9a49-7f9d97831364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:16.055112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991927b3-2965-4485-9a49-7f9d97831364 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:16.103017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1138/2298] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:16.108634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:16.118974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017bfeb-a914-4a28-a28b-1206926edaa0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:16.128729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:16.129431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:16.129775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:16.130046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] PATH_INFO: `/v3/projects/7b936cafaa81481a8914ac9df9fe24fa/users/3d6d4705d07444be96cf741aae38c02a/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:16.154112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b936cafaa81481a8914ac9df9fe24fa, user_id=3d6d4705d07444be96cf741aae38c02a, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:16.157369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:16.179760 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1161/2299] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:16 2022] PUT /identity/v3/projects/7b936cafaa81481a8914ac9df9fe24fa/users/3d6d4705d07444be96cf741aae38c02a/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:16.191515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:16.191515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:16.191734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:16.282130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] MFA Rules not processed for user `3d6d4705d07444be96cf741aae38c02a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:16.283810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:16.485912 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1139/2300] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:16.517878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:16.522325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:16.573516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:16.627147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0176a-d18a-4c17-9d86-67472796ddcf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:16.632595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc9936-ef12-460a-805c-1f928803b02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:16.633462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc9936-ef12-460a-805c-1f928803b02a service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:16.634751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc9936-ef12-460a-805c-1f928803b02a service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:16.635198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc9936-ef12-460a-805c-1f928803b02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:16.668077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc9936-ef12-460a-805c-1f928803b02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:16.670156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc9936-ef12-460a-805c-1f928803b02a service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:16.686063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1162/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:16.872580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:16.878789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:16.903637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4658e5e-cf70-4b41-83df-26a2a4d530bc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:16.912926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:16.917285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:16.917757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:16.918205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:16.921034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:16.955408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:17.063263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:17.065359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:17.092662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1140/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:18.255641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac57a0-159c-40d8-859d-6ef8df2aab08 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:18.256090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac57a0-159c-40d8-859d-6ef8df2aab08 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:18.256177 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac57a0-159c-40d8-859d-6ef8df2aab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:18.291014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e9ac57a0-159c-40d8-859d-6ef8df2aab08 None None] MFA Rules not processed for user `c043ad0f840e4ce2b4ec36a0425f560f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:18.292498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e9ac57a0-159c-40d8-859d-6ef8df2aab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:18.377945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1163/2303] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:18.391375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:18.392813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:18.476050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207efd8c-21c3-4956-8134-0c45286346e8 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:18.481350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:18.482469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:18.482913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:18.484247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:18.486235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:18.597950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:18.599629 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:18.636004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1141/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:18.891921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:18.893371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:18.894229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:18.976720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:18.978176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:19.072141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1164/2305] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:17:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:19.127276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:19.128708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:19.228605 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784575-1d53-4ca9-81e8-723a651c6d0e service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:19.233774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62a88-8b46-4bd5-bd13-dc781fe371cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:19.234637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62a88-8b46-4bd5-bd13-dc781fe371cf service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:19.234914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62a88-8b46-4bd5-bd13-dc781fe371cf service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:19.235231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62a88-8b46-4bd5-bd13-dc781fe371cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:19.243827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62a88-8b46-4bd5-bd13-dc781fe371cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:19.245398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62a88-8b46-4bd5-bd13-dc781fe371cf service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:19.255281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1142/2306] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:17:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:17:22.448781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:22.451636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:22.663845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:22.728116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96cbc8-dc0b-4e5d-ab03-5ec6726593ea None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:22.740673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:22.741331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:22.741612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:22.741884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] PATH_INFO: `/v3/users/5151642a99104a2ebb69a9e776064610` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:22.744418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5151642a99104a2ebb69a9e776064610)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:22.750558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:22.942067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5151642a99104a2ebb69a9e776064610'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:22.943360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5151642a99104a2ebb69a9e776064610'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:22.944317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5151642a99104a2ebb69a9e776064610'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:22.995026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5151642a99104a2ebb69a9e776064610'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:23.018638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5151642a99104a2ebb69a9e776064610'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:23.059223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1165/2307] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:22 2022] DELETE /identity/v3/users/5151642a99104a2ebb69a9e776064610 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:23.066624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:23.067187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:23.067187 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:23.084334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:23.162477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:23.170440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:23.413791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1143/2308] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:23.427889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:23.429717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:23.672084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac81cd-6c72-43a8-9179-e4a192b42c00 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:23.686342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:23.688439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:23.690393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:23.690858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:23.717407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:23.721083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:23.741902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1166/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:24.554156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:24.558028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:24.576164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeece98-ea80-478a-8a22-2d084b818c7a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:24.595211 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:24.596440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:24.597326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:24.597808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] PATH_INFO: `/v3/projects/bd3660c13a2d4f1dbd474a2f8a775511` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:24.599633 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3660c13a2d4f1dbd474a2f8a775511)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:24.602212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:24.674945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3660c13a2d4f1dbd474a2f8a775511', 'request_id': 'req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:24.684247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3660c13a2d4f1dbd474a2f8a775511', 'request_id': 'req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:24.699099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:24.700284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3660c13a2d4f1dbd474a2f8a775511', 'request_id': 'req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:24.701438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:24.731776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe6e6-5534-4a1d-b947-babfc9612017 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:24.740263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] The token cache is being invalidate because project bd3660c13a2d4f1dbd474a2f8a775511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:24.740541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:24.746238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:24.750155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1144/2310] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:24 2022] DELETE /identity/v3/projects/bd3660c13a2d4f1dbd474a2f8a775511 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:24.753820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:24.757337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:24.902807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:24.903498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:24.903779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:24.904049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] PATH_INFO: `/v3/users/3d6d4705d07444be96cf741aae38c02a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:24.907258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6d4705d07444be96cf741aae38c02a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:24.914217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:24.957520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecf2fe-9a0b-4ab4-ba3b-2f1daeae3b00 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:24.959201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:24.965536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:24.966188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:24.966470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:24.966744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] PATH_INFO: `/v3/users/6adb3841747e4e9fba9737de07aad8ff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:24.967998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adb3841747e4e9fba9737de07aad8ff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:24.969982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:25.018532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:25.021417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6d4705d07444be96cf741aae38c02a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.023767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6d4705d07444be96cf741aae38c02a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.027844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6d4705d07444be96cf741aae38c02a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.049343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adb3841747e4e9fba9737de07aad8ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.050083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adb3841747e4e9fba9737de07aad8ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.050690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adb3841747e4e9fba9737de07aad8ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.064285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6d4705d07444be96cf741aae38c02a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.065906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adb3841747e4e9fba9737de07aad8ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.080967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adb3841747e4e9fba9737de07aad8ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.084959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-004b099b-95ef-4c3e-9219-99456aa7604f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6d4705d07444be96cf741aae38c02a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:25.113850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1167/2311] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:24 2022] DELETE /identity/v3/users/3d6d4705d07444be96cf741aae38c02a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:25.116783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:25.117073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:25.117503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:25.148994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1145/2312] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:24 2022] DELETE /identity/v3/users/6adb3841747e4e9fba9737de07aad8ff => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:25.225680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:25.226940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:25.379552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1168/2313] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:25.380684 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:25.382677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:25.611942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575d62c-eeaf-4b12-81b0-c36e3e43d65c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:25.617708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:25.620027 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:25.620530 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:25.621129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:25.648508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:25.652636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:25.667095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1146/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:26.071145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:26.073392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:26.090537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94377-55a0-4662-ba5d-30ec8c459892 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:26.121143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:26.122254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:26.122751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:26.123255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] PATH_INFO: `/v3/projects/bcaeac7d65244a8fa0159e8e796987ee` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:26.131024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcaeac7d65244a8fa0159e8e796987ee)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:26.137114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:26.280178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcaeac7d65244a8fa0159e8e796987ee', 'request_id': 'req-45a7d912-2c40-4ea2-a646-bc2977347454'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.291897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcaeac7d65244a8fa0159e8e796987ee', 'request_id': 'req-45a7d912-2c40-4ea2-a646-bc2977347454'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.338512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcaeac7d65244a8fa0159e8e796987ee', 'request_id': 'req-45a7d912-2c40-4ea2-a646-bc2977347454'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.357923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] The token cache is being invalidate because project bcaeac7d65244a8fa0159e8e796987ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:26.358607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.359735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.364572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1169/2315] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:26 2022] DELETE /identity/v3/projects/bcaeac7d65244a8fa0159e8e796987ee => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:26.366107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:26.381400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d444a6-e28a-4e81-af8e-e258dfd8fd65 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:26.489565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:26.491817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:26.498296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:26.498936 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:26.499251 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:26.499625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] PATH_INFO: `/v3/users/7e2ead8616544eb9b28cb085a2e5e4bd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:26.500830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2ead8616544eb9b28cb085a2e5e4bd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:26.504288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:26.512114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7d912-2c40-4ea2-a646-bc2977347454 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:26.519411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:26.520616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:26.521000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:26.521855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] PATH_INFO: `/v3/projects/7b936cafaa81481a8914ac9df9fe24fa` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:26.523708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b936cafaa81481a8914ac9df9fe24fa)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:26.526659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:26.554932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:26.633475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2ead8616544eb9b28cb085a2e5e4bd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.636191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2ead8616544eb9b28cb085a2e5e4bd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.636998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2ead8616544eb9b28cb085a2e5e4bd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.641669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:26.663771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2ead8616544eb9b28cb085a2e5e4bd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.673749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b936cafaa81481a8914ac9df9fe24fa', 'request_id': 'req-96b0861d-76b6-4e96-83d4-88552764f274'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.683755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4efdb445-9af2-4157-9219-1a802ac09433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2ead8616544eb9b28cb085a2e5e4bd'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.686172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b936cafaa81481a8914ac9df9fe24fa', 'request_id': 'req-96b0861d-76b6-4e96-83d4-88552764f274'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.699357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b936cafaa81481a8914ac9df9fe24fa', 'request_id': 'req-96b0861d-76b6-4e96-83d4-88552764f274'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.712012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1147/2316] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:26 2022] DELETE /identity/v3/users/7e2ead8616544eb9b28cb085a2e5e4bd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:26.723509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] The token cache is being invalidate because project 7b936cafaa81481a8914ac9df9fe24fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:26.723780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.725051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96b0861d-76b6-4e96-83d4-88552764f274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:26.727911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1170/2317] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:26 2022] DELETE /identity/v3/projects/7b936cafaa81481a8914ac9df9fe24fa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:26.732223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:26.732739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:26.733016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:26.764110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:26.765716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:26.879054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1148/2318] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:26.881559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:26.881879 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:26.882224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:26.911802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:26.915549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:26.936036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1171/2319] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:26.940445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:26.965838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce400-6a1c-48f7-ac46-6e0c1fbf55ee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:26.991088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:26.996091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:26.996449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:26.996620 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:26.998283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:26.999327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.003716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.070751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1149/2320] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:17:27.071726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.091131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533318b-35d8-4313-8717-4b9fce3b4a51 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.108952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.111508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.111794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.112075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.112752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.126615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.229069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1172/2321] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:27 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:27.229702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.261447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7af1e-5a5b-4ac8-8db7-6f5574af87bd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.404423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.405056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.405334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.407028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.408695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.410755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.484109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1150/2322] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:27 2022] POST /identity/v3/users => generated 282 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:27.488200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.519003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cbe5-d392-4bf6-afda-5fa39f1166d6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.531663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.532444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.532832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.533195 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.535537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.537269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.557034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.559426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:27.577868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc3a7-4d85-40a1-8f81-ea742dd294a5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.599833 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1173/2323] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:27.602282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.613922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.617733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.618899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.618899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] PATH_INFO: `/v3/projects/293390f231764124a6c5ead5dfd29770` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.620327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] RBAC: Authorizing `identity:delete_project(project_id=293390f231764124a6c5ead5dfd29770)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.622220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.646594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737a468-2099-43ad-a167-97e440eaed63 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.662800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.663622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.663977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.664357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.665931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.667959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.695370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1174/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:27.706068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.710405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:27.715305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:27.732997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293390f231764124a6c5ead5dfd29770', 'request_id': 'req-fc7533ed-4789-409b-8577-518966e7623e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.747245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2317a-28ce-4cc8-aaa8-fe73cce2143c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.756647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293390f231764124a6c5ead5dfd29770', 'request_id': 'req-fc7533ed-4789-409b-8577-518966e7623e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.767581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293390f231764124a6c5ead5dfd29770', 'request_id': 'req-fc7533ed-4789-409b-8577-518966e7623e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.791588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] The token cache is being invalidate because project 293390f231764124a6c5ead5dfd29770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:27.791879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.793636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.802895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1151/2325] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:27 2022] DELETE /identity/v3/projects/293390f231764124a6c5ead5dfd29770 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:27.802895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:27.806954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:27.882043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.882706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.882985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.883282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] PATH_INFO: `/v3/users/d79c4171953546eab247dc95079c4471` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.884705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79c4171953546eab247dc95079c4471)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.886637 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:27.965440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7533ed-4789-409b-8577-518966e7623e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:27.970424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8446c-9f44-416b-bfdc-ba00389007a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:27.971106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8446c-9f44-416b-bfdc-ba00389007a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:27.971415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8446c-9f44-416b-bfdc-ba00389007a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:27.971693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8446c-9f44-416b-bfdc-ba00389007a3 admin admin] PATH_INFO: `/v3/projects/6199d586c18240bdb118905d42497fca/users/f5a404546cc94575a1129a24dcfb55b0/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:27.988381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79c4171953546eab247dc95079c4471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.989164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79c4171953546eab247dc95079c4471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.990493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79c4171953546eab247dc95079c4471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:27.995197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8446c-9f44-416b-bfdc-ba00389007a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6199d586c18240bdb118905d42497fca, user_id=f5a404546cc94575a1129a24dcfb55b0, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:27.997847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8446c-9f44-416b-bfdc-ba00389007a3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.004337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:28.015732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79c4171953546eab247dc95079c4471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:28.023263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1152/2326] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:27 2022] PUT /identity/v3/projects/6199d586c18240bdb118905d42497fca/users/f5a404546cc94575a1129a24dcfb55b0/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:28.025468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cfa8e-f465-43c3-897f-2ad0c7937896 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.027055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cfa8e-f465-43c3-897f-2ad0c7937896 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.027384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cfa8e-f465-43c3-897f-2ad0c7937896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.028063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-949867d0-7d31-4f42-a8e2-f07ed5952fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79c4171953546eab247dc95079c4471'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:28.048387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1e4cfa8e-f465-43c3-897f-2ad0c7937896 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:28.049609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e4cfa8e-f465-43c3-897f-2ad0c7937896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:28.050836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1175/2327] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:17:27 2022] DELETE /identity/v3/users/d79c4171953546eab247dc95079c4471 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:28.052273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.052565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.052828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.087836 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] MFA Rules not processed for user `f5a404546cc94575a1129a24dcfb55b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:28.089043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:28.161667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1153/2328] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:28.173299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86640f0a-ba45-4a1d-a830-a2043be1b784 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.173299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86640f0a-ba45-4a1d-a830-a2043be1b784 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.173299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86640f0a-ba45-4a1d-a830-a2043be1b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.198445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-86640f0a-ba45-4a1d-a830-a2043be1b784 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:28.200086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-86640f0a-ba45-4a1d-a830-a2043be1b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:28.209700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1154/2329] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:28.211179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.211485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.212300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.255958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1176/2330] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:28.257551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.260011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:28.265326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:28.266540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:28.284541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1155/2331] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:28.284541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.284541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:28.339342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf61ce-7d7c-481d-9dcb-a0ed7cffd878 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.344249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.345181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.345410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.345685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.358408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.361729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.381963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1177/2332] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:28.386206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:28.399121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.452470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dc0fd-9045-4013-840f-594182988244 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.455681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541a45-6bb8-4ff6-9aee-4ab03065ee44 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.457031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.457849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.458350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.458785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.464212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.464938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.465280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.465805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.466657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:28.467099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.470272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.474790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.476903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.495931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1178/2333] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:17:28.497188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.511651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444fefd-0ad1-4af0-84e5-0f856705d542 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.512269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1156/2334] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:28.518191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.519461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.519816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.520770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.521162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.523317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.581113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1179/2335] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:28 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:28.585643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.615057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3130e52-4d87-49be-8e51-e1bf5a031521 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.758172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.759875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.760430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.760921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.763133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.765567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.801343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1157/2336] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:28 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:28.806563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.826437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86121f-df93-486e-8e06-cba1653a08d5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.840089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.840852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.842337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.842697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.856820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.863463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:28.900529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1180/2337] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:28.902208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:28.916869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b38c1-d11a-44fe-85e2-adec28b617fd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:28.929687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0deee0-1d52-4d1c-8f48-b6ec29a30ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:28.930384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0deee0-1d52-4d1c-8f48-b6ec29a30ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:28.931744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0deee0-1d52-4d1c-8f48-b6ec29a30ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:28.932253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0deee0-1d52-4d1c-8f48-b6ec29a30ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:28.933540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0deee0-1d52-4d1c-8f48-b6ec29a30ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:28.946285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0deee0-1d52-4d1c-8f48-b6ec29a30ca9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:29.002186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1158/2338] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:29.015389 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:29.035043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505b424-e15a-439a-ad4b-ae85586d8f87 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:29.051428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:29.052125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:29.052408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:29.052685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] PATH_INFO: `/v3/projects/d6cfe15028dd44bd974a1294eba8f404/users/32403a3966f740c6b0a5319bcb3d9c05/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:29.077149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:29.089945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cfe15028dd44bd974a1294eba8f404, user_id=32403a3966f740c6b0a5319bcb3d9c05, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:29.094516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:29.138657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1181/2339] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:29 2022] PUT /identity/v3/projects/d6cfe15028dd44bd974a1294eba8f404/users/32403a3966f740c6b0a5319bcb3d9c05/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:29.143551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:29.144103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:29.144602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:29.229800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:29.235998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:29.431918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1159/2340] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:29.501594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:29.501594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:29.501898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:29.506053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:29.544547 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7630c-5165-4f56-bf20-719b6816e7d3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:29.552953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:29.553604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:29.553888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:29.554161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] PATH_INFO: `/v3/projects/00f8ba665ddf4158bf5593a004512e9c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:29.555576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f8ba665ddf4158bf5593a004512e9c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:29.564826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:29.676458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c105914-1299-4683-bbf3-b68ddb16b508 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:29.691090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb83d7-9230-451c-a84e-582d2924caec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:29.694278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb83d7-9230-451c-a84e-582d2924caec service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:29.694566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb83d7-9230-451c-a84e-582d2924caec service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:29.696016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb83d7-9230-451c-a84e-582d2924caec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:29.721604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f8ba665ddf4158bf5593a004512e9c', 'request_id': 'req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:29.735297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:29.740651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb83d7-9230-451c-a84e-582d2924caec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:29.742913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb83d7-9230-451c-a84e-582d2924caec service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:29.746541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f8ba665ddf4158bf5593a004512e9c', 'request_id': 'req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:29.776602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1182/2341] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:29.793218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f8ba665ddf4158bf5593a004512e9c', 'request_id': 'req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:29.853136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] The token cache is being invalidate because project 00f8ba665ddf4158bf5593a004512e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:17:29.854916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:29.857988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-904f06a6-913c-4d94-845a-9a2fbd1b7f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:17:29.860876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1160/2342] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:17:29 2022] DELETE /identity/v3/projects/00f8ba665ddf4158bf5593a004512e9c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:17:29.865895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:29.866225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:29.866568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:29.903978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:29.905315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:30.008447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1183/2343] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:30.017004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.017303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.017572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.046842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:30.048117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:30.070302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1161/2344] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:30.071800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:30.083924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18607e5e-7734-4307-8f2b-5de57547b28e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:30.090418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:30.091792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.092227 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.092667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.094697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:17:30.095208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:30.097456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:30.116512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1184/2345] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:17:30.121800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:30.134952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e77d9-bc95-4b68-bb46-617a5a7799c8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:30.142058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c64b8-9583-471e-af2c-e307c7c5a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:30.143213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c64b8-9583-471e-af2c-e307c7c5a605 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.143506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c64b8-9583-471e-af2c-e307c7c5a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.143778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c64b8-9583-471e-af2c-e307c7c5a605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.144450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c64b8-9583-471e-af2c-e307c7c5a605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:30.147615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c64b8-9583-471e-af2c-e307c7c5a605 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:30.315465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:30.317551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1162/2346] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:17:30 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:17:30.333258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc63d4-51ae-4c9f-b2c7-4ef5eba99eec admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:30.345160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.345521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.345907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.412948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] MFA Rules not processed for user `e2e1c3179d064773be0fbb06559fdfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:30.417508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:30.489752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:30.490631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.491417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.491897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.492756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:30.495658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:30.535263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1185/2347] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:17:30 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:17:30.542409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:30.561408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ece70-3097-4177-a0a9-97c6a24b33a7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:30.571963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:30.572677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.573011 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.573554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.574264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:30.576034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:30.582224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:30.592396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1186/2348] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:30.595481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:30.599209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1163/2349] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:30.615284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672bb08-b041-4379-87fa-8332716ec8c3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:30.629209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf3946-5a19-4058-bd7e-367c624888a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:30.630278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf3946-5a19-4058-bd7e-367c624888a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.630594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf3946-5a19-4058-bd7e-367c624888a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.632100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf3946-5a19-4058-bd7e-367c624888a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.633725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf3946-5a19-4058-bd7e-367c624888a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:30.636305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf3946-5a19-4058-bd7e-367c624888a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:30.669823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:30.670324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1187/2350] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:17:30.689882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2184d-ea67-41c1-9803-e959c3d8ac63 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:30.700966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:30.703621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.704910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.705543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] PATH_INFO: `/v3/projects/1a88e2624c634ba69c780e9e7d19ab04/users/773d559dd73e47b5972ee0b04d9ace5c/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.750081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a88e2624c634ba69c780e9e7d19ab04, user_id=773d559dd73e47b5972ee0b04d9ace5c, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:30.755677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:30.794240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1164/2351] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:17:30 2022] PUT /identity/v3/projects/1a88e2624c634ba69c780e9e7d19ab04/users/773d559dd73e47b5972ee0b04d9ace5c/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:17:30.815635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505a13-6e7c-4764-b807-f58184253aef None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:30.816142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505a13-6e7c-4764-b807-f58184253aef None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:30.816626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505a13-6e7c-4764-b807-f58184253aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:30.892620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-af505a13-6e7c-4764-b807-f58184253aef None None] MFA Rules not processed for user `773d559dd73e47b5972ee0b04d9ace5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:30.894533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af505a13-6e7c-4764-b807-f58184253aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:31.079288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1188/2352] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:31.088478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:31.090891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:31.226770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ecb2a-c3d2-48dc-bbde-54933b812595 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:31.232246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:31.233423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:31.234039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:31.234321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:31.244830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:31.250953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:31.284736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1165/2353] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:31.422006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a518f-7a99-405b-a5ad-a1e6d26b2976 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:31.423200 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a518f-7a99-405b-a5ad-a1e6d26b2976 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:31.423694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a518f-7a99-405b-a5ad-a1e6d26b2976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:31.481368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-070a518f-7a99-405b-a5ad-a1e6d26b2976 None None] MFA Rules not processed for user `32403a3966f740c6b0a5319bcb3d9c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:31.483687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-070a518f-7a99-405b-a5ad-a1e6d26b2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:31.639705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1189/2354] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:31.672147 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:31.673745 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:31.705300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790fd5a-b9ee-4f38-9abe-93a8f2fe6b0e service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:31.721554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525fb1-9f0f-43b6-a2af-049f750bacf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:31.725722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525fb1-9f0f-43b6-a2af-049f750bacf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:31.726004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525fb1-9f0f-43b6-a2af-049f750bacf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:31.726270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525fb1-9f0f-43b6-a2af-049f750bacf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:31.754267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525fb1-9f0f-43b6-a2af-049f750bacf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:31.755768 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525fb1-9f0f-43b6-a2af-049f750bacf1 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:31.797553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1166/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:17:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:17:33.130779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8253d34-edc4-4f49-90d5-7c6ef3be2d69 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:33.131730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8253d34-edc4-4f49-90d5-7c6ef3be2d69 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:33.132156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8253d34-edc4-4f49-90d5-7c6ef3be2d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:33.200944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f8253d34-edc4-4f49-90d5-7c6ef3be2d69 None None] MFA Rules not processed for user `773d559dd73e47b5972ee0b04d9ace5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:33.205729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f8253d34-edc4-4f49-90d5-7c6ef3be2d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:33.234171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1190/2356] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:33.588927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f6aad-1dde-4d32-9c88-2a7165063644 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:33.589902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f6aad-1dde-4d32-9c88-2a7165063644 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:33.590436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f6aad-1dde-4d32-9c88-2a7165063644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:33.648866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5d3f6aad-1dde-4d32-9c88-2a7165063644 None None] MFA Rules not processed for user `32403a3966f740c6b0a5319bcb3d9c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:33.650556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5d3f6aad-1dde-4d32-9c88-2a7165063644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:33.676505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1167/2357] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:17:39.529593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:39.530165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:39.530165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:39.557566 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] MFA Rules not processed for user `fcf158775e4048e6889f5c7b54e99706`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:39.558933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:39.635612 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1191/2358] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:42.484477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:42.484910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:42.484910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:42.504825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:17:42.506159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:42.519870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:42.587250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:17:42.589453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:17:42.590631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1168/2359] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:17:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:17:42.601046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:42.678286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22ea26-f355-4b0b-887d-7b74eee96a47 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:17:42.705045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed996b-579b-4d01-aa66-7906714f0624 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:17:42.705045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed996b-579b-4d01-aa66-7906714f0624 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:17:42.705045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed996b-579b-4d01-aa66-7906714f0624 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:17:42.705045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed996b-579b-4d01-aa66-7906714f0624 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:17:42.721738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed996b-579b-4d01-aa66-7906714f0624 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:17:42.724605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed996b-579b-4d01-aa66-7906714f0624 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:17:42.743325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1192/2360] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:17:52.563732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=17 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:52.733719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=29 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:04.163479 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:04.166246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:04.231672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec32ec-d9ae-4e14-9881-5b54412473d1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:04.236188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:04.236814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:04.237096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:04.237373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] PATH_INFO: `/v3/users/f5a404546cc94575a1129a24dcfb55b0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:04.238525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a404546cc94575a1129a24dcfb55b0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:04.240465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:04.286503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a404546cc94575a1129a24dcfb55b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:04.287142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a404546cc94575a1129a24dcfb55b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:04.287772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a404546cc94575a1129a24dcfb55b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:04.295325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a404546cc94575a1129a24dcfb55b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:04.302319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a404546cc94575a1129a24dcfb55b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:04.319718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1169/2361] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:18:04 2022] DELETE /identity/v3/users/f5a404546cc94575a1129a24dcfb55b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:04.324291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:04.324815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:04.324941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:04.343781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:04.344977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:04.403375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1193/2362] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:04.413212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:04.414687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:04.471727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48620-1fd0-44c5-9a5f-01e3f8582508 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:04.475329 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a6d3-4d90-4c76-9a71-63c730059eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:04.475928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a6d3-4d90-4c76-9a71-63c730059eee service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:04.476206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a6d3-4d90-4c76-9a71-63c730059eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:04.476477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a6d3-4d90-4c76-9a71-63c730059eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:04.485244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790a6d3-4d90-4c76-9a71-63c730059eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:04.486650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790a6d3-4d90-4c76-9a71-63c730059eee service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:04.496784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1170/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:18:04.982167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:04.983864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:05.000553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246dbf-a0f6-406c-8574-cf39aa74865d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.021246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.022218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.022724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.023240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] PATH_INFO: `/v3/projects/6199d586c18240bdb118905d42497fca` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.027613 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6199d586c18240bdb118905d42497fca)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.030335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.083889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6199d586c18240bdb118905d42497fca', 'request_id': 'req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:05.090159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6199d586c18240bdb118905d42497fca', 'request_id': 'req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:05.098901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6199d586c18240bdb118905d42497fca', 'request_id': 'req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:05.127783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] The token cache is being invalidate because project 6199d586c18240bdb118905d42497fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:18:05.128170 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:05.128887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-637d9a09-b02b-4166-b3c9-8ce2ec8711ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:05.130481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1194/2364] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:18:04 2022] DELETE /identity/v3/projects/6199d586c18240bdb118905d42497fca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:05.136210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.136536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.136783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.168229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:05.170286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:05.193153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:05.252799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1171/2365] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:05.261798 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf164-2213-47f6-8571-09e454903866 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.262094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf164-2213-47f6-8571-09e454903866 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.262340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf164-2213-47f6-8571-09e454903866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.296432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-50fcf164-2213-47f6-8571-09e454903866 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:05.297726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-50fcf164-2213-47f6-8571-09e454903866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:05.311205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1195/2366] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:05.312910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.326743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e4bc-1506-47cb-b025-b0d2b46d39af None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.332475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.333124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.333408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.333690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.335004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:18:05.335354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.337610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.350166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1172/2367] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:18:05.354949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf164-2213-47f6-8571-09e454903866 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.372426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf164-2213-47f6-8571-09e454903866 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.377104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.377716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.377996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.378267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.378936 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.380872 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.415587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1196/2368] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:18:05 2022] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:18:05.420062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.430766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e1be9-4301-40a1-9605-b1dbbd56d59b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.490278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.490888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.491193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.491469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.492141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.494879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.516234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1173/2369] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:18:05 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:18:05.520431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.531924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c75163-044d-4aa9-b947-6bed3487d346 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.536537 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.537139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.537421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.537691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.538377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.541235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.550998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1197/2370] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:18:05.554812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.565023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783122c-e0c5-4a46-8839-7079bf152e0a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.569871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fea18-ce3b-4aef-9667-40cebd4ca141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.570474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fea18-ce3b-4aef-9667-40cebd4ca141 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.570781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fea18-ce3b-4aef-9667-40cebd4ca141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.571057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fea18-ce3b-4aef-9667-40cebd4ca141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.571797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fea18-ce3b-4aef-9667-40cebd4ca141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.573392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fea18-ce3b-4aef-9667-40cebd4ca141 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.584036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1174/2371] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:18:05.588649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.598378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298d75-0184-440c-8ec1-a9963837801e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.603955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.604614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.604895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.605174 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] PATH_INFO: `/v3/projects/afb0439a434849ed92126361fb03f760/users/67942d435726477a86a50bd89e36b765/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.620583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb0439a434849ed92126361fb03f760, user_id=67942d435726477a86a50bd89e36b765, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.623242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.635558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1198/2372] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:18:05 2022] PUT /identity/v3/projects/afb0439a434849ed92126361fb03f760/users/67942d435726477a86a50bd89e36b765/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:05.645657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.645969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.646270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.675591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] MFA Rules not processed for user `67942d435726477a86a50bd89e36b765`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:05.676817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:05.744782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1175/2373] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:05.756669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:05.759022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:05.781899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:05.822586 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d054e2c-9ac9-4f7c-a7c5-1f5951d96d23 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:05.827453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa79eba-6f8e-47b2-99dd-6ad5300709db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:05.828403 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa79eba-6f8e-47b2-99dd-6ad5300709db service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:05.828781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa79eba-6f8e-47b2-99dd-6ad5300709db service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:05.829501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa79eba-6f8e-47b2-99dd-6ad5300709db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:05.838205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa79eba-6f8e-47b2-99dd-6ad5300709db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:05.839788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa79eba-6f8e-47b2-99dd-6ad5300709db service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:05.850103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1199/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:10.985916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:11.005154 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:11.052166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd7cb-4a30-4b86-817f-4dd9ca8d4a81 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:11.056758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:11.057412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:11.057694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:11.057969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] PATH_INFO: `/v3/users/67942d435726477a86a50bd89e36b765` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:11.059293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67942d435726477a86a50bd89e36b765)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:11.061220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:11.109429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67942d435726477a86a50bd89e36b765'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.110067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67942d435726477a86a50bd89e36b765'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.110704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67942d435726477a86a50bd89e36b765'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.117592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67942d435726477a86a50bd89e36b765'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.124578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67942d435726477a86a50bd89e36b765'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.142498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1176/2375] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:18:10 2022] DELETE /identity/v3/users/67942d435726477a86a50bd89e36b765 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:11.146962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:11.147492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:11.147588 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:11.166907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:11.168148 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:11.234795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1200/2376] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:11.244529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:11.247558 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:11.335450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14086d-458b-4bda-947f-f94a7c0f549f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:11.339923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece0da-d6b7-45cb-9f95-b4a01abf5285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:11.340617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece0da-d6b7-45cb-9f95-b4a01abf5285 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:11.340957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece0da-d6b7-45cb-9f95-b4a01abf5285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:11.341292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece0da-d6b7-45cb-9f95-b4a01abf5285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:11.350823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ece0da-d6b7-45cb-9f95-b4a01abf5285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:11.352601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ece0da-d6b7-45cb-9f95-b4a01abf5285 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:11.362815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1177/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:11.729702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:11.731253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:11.744338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b57e-5e96-4131-9e68-6b84781418ac None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:11.749321 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:11.749975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:11.750261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:11.750562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] PATH_INFO: `/v3/projects/afb0439a434849ed92126361fb03f760` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:11.751952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb0439a434849ed92126361fb03f760)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:11.753883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:11.832858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb0439a434849ed92126361fb03f760', 'request_id': 'req-b0d29283-b4ce-45ae-b716-f390e85c516f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.840536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb0439a434849ed92126361fb03f760', 'request_id': 'req-b0d29283-b4ce-45ae-b716-f390e85c516f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.847501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb0439a434849ed92126361fb03f760', 'request_id': 'req-b0d29283-b4ce-45ae-b716-f390e85c516f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.873624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] The token cache is being invalidate because project afb0439a434849ed92126361fb03f760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:18:11.874302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.877670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:11.881171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1201/2378] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:18:11 2022] DELETE /identity/v3/projects/afb0439a434849ed92126361fb03f760 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:14.653189 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a9e3a-9bea-4f03-b08d-7ecf1a3b2a43 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:14.653652 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a9e3a-9bea-4f03-b08d-7ecf1a3b2a43 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:14.653744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a9e3a-9bea-4f03-b08d-7ecf1a3b2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:14.675244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9c6a9e3a-9bea-4f03-b08d-7ecf1a3b2a43 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:14.676465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9c6a9e3a-9bea-4f03-b08d-7ecf1a3b2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:14.737015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:14.776774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1178/2379] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:18:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:18:14.785887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:14.792263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:14.855494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:14.881184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d29283-b4ce-45ae-b716-f390e85c516f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:14.886635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496bb77-0d8b-4758-8ec3-2d22af1e0279 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:14.887290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496bb77-0d8b-4758-8ec3-2d22af1e0279 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:14.887574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496bb77-0d8b-4758-8ec3-2d22af1e0279 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:14.887850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496bb77-0d8b-4758-8ec3-2d22af1e0279 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:14.897977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496bb77-0d8b-4758-8ec3-2d22af1e0279 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:14.899746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496bb77-0d8b-4758-8ec3-2d22af1e0279 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:14.908451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1202/2380] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:17.453630 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:17.454292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:17.454292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:17.474481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] MFA Rules not processed for user `20bd2f5da95a4d029adbe7b1e0f75bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:17.475767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:17.559196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1179/2381] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:24.905303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=11 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:27.546194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=32 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:30.546912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dc556-8373-44fb-8900-5a377673156d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:30.547621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dc556-8373-44fb-8900-5a377673156d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:30.547621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dc556-8373-44fb-8900-5a377673156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:30.569184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-615dc556-8373-44fb-8900-5a377673156d None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:30.569184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-615dc556-8373-44fb-8900-5a377673156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:30.577035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1203/2382] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:30.597852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:30.612931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8badd-8f13-4323-ac42-854e7d016d1d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:30.618441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f2bfd-803c-4998-9744-2c5a3d2d6b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:30.619059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f2bfd-803c-4998-9744-2c5a3d2d6b8c service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:30.619369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f2bfd-803c-4998-9744-2c5a3d2d6b8c service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:30.619639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f2bfd-803c-4998-9744-2c5a3d2d6b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:30.629812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f2bfd-803c-4998-9744-2c5a3d2d6b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:30.631424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f2bfd-803c-4998-9744-2c5a3d2d6b8c service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:30.641281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1180/2383] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:31.273113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dc556-8373-44fb-8900-5a377673156d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:31.274739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-615dc556-8373-44fb-8900-5a377673156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:31.399735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dc556-8373-44fb-8900-5a377673156d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:31.407561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:31.408160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:31.413457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:31.413457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:31.418237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:31.500103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:31.500384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:31.500655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:31.524240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:31.525526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:31.556009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:31.557715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf972243-839b-4728-9376-8f865fb2eaa0 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:31.560176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1181/2384] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 05:18:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:18:31.592801 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1204/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:31.602105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:31.619283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0a78c-28b2-437f-b1fe-8d7008795997 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:31.625103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:31.626110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:31.626562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:31.627016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:31.643497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:31.646057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:31.678793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1182/2386] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:32.315934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d25aa-9018-43cf-8cf0-3584fa55c481 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:32.316219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d25aa-9018-43cf-8cf0-3584fa55c481 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:32.316488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d25aa-9018-43cf-8cf0-3584fa55c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:32.359462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b77d25aa-9018-43cf-8cf0-3584fa55c481 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:32.361579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b77d25aa-9018-43cf-8cf0-3584fa55c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:32.376916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1205/2387] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:18:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:32.390541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:32.402165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa923e6-6a3a-4f5f-80b2-aa1de751bd02 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:32.409623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:32.410544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:32.411343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:32.412003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:32.423345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:32.424959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:32.433876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1183/2388] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 05:18:32.963885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:32.964474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:32.964474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:32.990479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:32.991793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:33.001374 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1206/2389] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 05:18:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:33.018917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:33.033873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21b11-8ed5-4b50-afd2-123251961f60 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:33.043835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcade12-c1f2-40b3-9dca-3cc8f6762668 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:33.045742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcade12-c1f2-40b3-9dca-3cc8f6762668 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:33.046193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcade12-c1f2-40b3-9dca-3cc8f6762668 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:33.046930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcade12-c1f2-40b3-9dca-3cc8f6762668 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:33.056672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcade12-c1f2-40b3-9dca-3cc8f6762668 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:33.058681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcade12-c1f2-40b3-9dca-3cc8f6762668 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:33.089823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1184/2390] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:36.155897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:36.157517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:36.301666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0279c-de6d-4fc6-8059-e7e47e8a85d7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:36.316634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:36.317709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:36.318609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:36.319094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] PATH_INFO: `/v3/users/773d559dd73e47b5972ee0b04d9ace5c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:36.321677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=773d559dd73e47b5972ee0b04d9ace5c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:36.326642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:36.433770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:36.462961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773d559dd73e47b5972ee0b04d9ace5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:36.466671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773d559dd73e47b5972ee0b04d9ace5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:36.468214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773d559dd73e47b5972ee0b04d9ace5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:36.503810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773d559dd73e47b5972ee0b04d9ace5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:36.523816 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773d559dd73e47b5972ee0b04d9ace5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:36.553337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1207/2391] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:18:36 2022] DELETE /identity/v3/users/773d559dd73e47b5972ee0b04d9ace5c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:36.557799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:36.558739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:36.560631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:36.594163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:36.595784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:36.709862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1185/2392] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:37.202079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:37.204402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:37.364280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67abd5-078d-4218-bb5e-29f20183c7cd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:37.379384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a4ed-f178-4d99-8084-41e69e473790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:37.380205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a4ed-f178-4d99-8084-41e69e473790 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:37.380878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a4ed-f178-4d99-8084-41e69e473790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:37.381225 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a4ed-f178-4d99-8084-41e69e473790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:37.433855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a4ed-f178-4d99-8084-41e69e473790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:37.436038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a4ed-f178-4d99-8084-41e69e473790 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:37.448575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1208/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:37.920096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:37.923281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:37.979138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484a89-030f-4d82-aea7-24ff59bc5d60 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:37.997247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:37.997779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:38.001731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:38.003058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] PATH_INFO: `/v3/projects/1a88e2624c634ba69c780e9e7d19ab04` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:38.007492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a88e2624c634ba69c780e9e7d19ab04)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:38.010800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:38.082292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a88e2624c634ba69c780e9e7d19ab04', 'request_id': 'req-0f732e53-485c-4467-8d35-132bf9f349aa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:38.089511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a88e2624c634ba69c780e9e7d19ab04', 'request_id': 'req-0f732e53-485c-4467-8d35-132bf9f349aa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:38.098113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a88e2624c634ba69c780e9e7d19ab04', 'request_id': 'req-0f732e53-485c-4467-8d35-132bf9f349aa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:38.119677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] The token cache is being invalidate because project 1a88e2624c634ba69c780e9e7d19ab04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:18:38.120244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:38.121110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:38.123478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1186/2394] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:18:37 2022] DELETE /identity/v3/projects/1a88e2624c634ba69c780e9e7d19ab04 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:39.346046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d82e1f-24e0-4e28-ab8c-eb93145e328c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:39.346758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d82e1f-24e0-4e28-ab8c-eb93145e328c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:39.346758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d82e1f-24e0-4e28-ab8c-eb93145e328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:39.371639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-22d82e1f-24e0-4e28-ab8c-eb93145e328c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:39.374003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-22d82e1f-24e0-4e28-ab8c-eb93145e328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:39.458628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1209/2395] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:39.512233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:39.514815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:39.575838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:39.683191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732e53-485c-4467-8d35-132bf9f349aa admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:39.690350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:39.691473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:39.691906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:39.692445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:39.703606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:39.705803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:39.718700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1187/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:41.999234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:41.999786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:41.999786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:42.020228 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:42.021399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:42.067746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:42.078231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1210/2397] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:42.091303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:42.092840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:42.161978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd3db9-f36d-4d16-ab48-abaf2d5575cb service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:42.167774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf2e79-608d-4181-890d-1c69f729fd38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:42.168402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf2e79-608d-4181-890d-1c69f729fd38 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:42.168775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf2e79-608d-4181-890d-1c69f729fd38 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:42.169112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf2e79-608d-4181-890d-1c69f729fd38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:42.179491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf2e79-608d-4181-890d-1c69f729fd38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:42.181125 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf2e79-608d-4181-890d-1c69f729fd38 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:42.190954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1188/2398] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:44.190358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:44.192033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.209243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4683af-28ce-4ba9-8991-d434acaec10e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:44.218082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:44.218909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.219378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.219960 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] PATH_INFO: `/v3/users/e2e1c3179d064773be0fbb06559fdfda` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.221327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e1c3179d064773be0fbb06559fdfda)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:44.224103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:44.295014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e1c3179d064773be0fbb06559fdfda'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.296695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e1c3179d064773be0fbb06559fdfda'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.297339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e1c3179d064773be0fbb06559fdfda'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.317088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e1c3179d064773be0fbb06559fdfda'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.324792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e1c3179d064773be0fbb06559fdfda'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.342472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1211/2399] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:18:44 2022] DELETE /identity/v3/users/e2e1c3179d064773be0fbb06559fdfda => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:44.462501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.463418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.463863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.490834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:44.492098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.537509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:44.539372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.581446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1189/2400] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:44.609422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:44.611205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.624985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf1c2-9b0d-4e6e-a51e-432f8667bd96 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:44.629716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:44.630362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.630643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.630921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] PATH_INFO: `/v3/projects/537dc263f47c4bde82745f4caeceb2b6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.632263 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537dc263f47c4bde82745f4caeceb2b6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:44.634196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:44.680030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:44.705232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537dc263f47c4bde82745f4caeceb2b6', 'request_id': 'req-40a73021-3593-4a26-9779-1a840a6ca969'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.712161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537dc263f47c4bde82745f4caeceb2b6', 'request_id': 'req-40a73021-3593-4a26-9779-1a840a6ca969'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.719875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061db1d-a3a3-4098-82b2-c0ad252c1533 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:44.720417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537dc263f47c4bde82745f4caeceb2b6', 'request_id': 'req-40a73021-3593-4a26-9779-1a840a6ca969'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.732840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:44.737345 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] The token cache is being invalidate because project 537dc263f47c4bde82745f4caeceb2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:18:44.737723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.739448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40a73021-3593-4a26-9779-1a840a6ca969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:18:44.743087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1212/2401] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:18:44 2022] DELETE /identity/v3/projects/537dc263f47c4bde82745f4caeceb2b6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:44.746477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141342bd-50ff-4b6b-85a0-871bf12b7c1f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.747093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141342bd-50ff-4b6b-85a0-871bf12b7c1f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.747728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141342bd-50ff-4b6b-85a0-871bf12b7c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.769018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-141342bd-50ff-4b6b-85a0-871bf12b7c1f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:44.770205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-141342bd-50ff-4b6b-85a0-871bf12b7c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.791173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:44.791796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.792074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.792342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.794676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.831654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1213/2402] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:44.838523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.838807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.839080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.858702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:44.859907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:44.861603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:44.863175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:44.869368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1214/2403] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:18:44.873745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:44.873991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1190/2404] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:18:44.882914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d4099-2b2a-442b-97d2-4654d5c4a0ea None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:44.887991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:44.888749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.889028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.889298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.890019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:18:44.890273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:44.891901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:44.903631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1215/2405] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:18:44.907921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:44.917983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28d406-1422-4a56-88bf-8db27faacd80 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:44.923500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:44.924104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:44.924381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:44.924651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:44.925312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:44.927855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:44.960986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1191/2406] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:18:44 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:18:44.965116 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:44.975038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d6d6-a703-4907-914a-81f7f2427b4f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:45.030949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:45.031583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:45.031860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:45.032125 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:45.032766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:45.034676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:45.060923 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1216/2407] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:18:44 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:18:45.062577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:45.073267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76036f-56b7-4ff2-b78c-22c31edd9ef0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:45.079231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:45.079847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:45.080121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:45.080397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:45.081084 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:45.082815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:45.094557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1192/2408] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:18:45.098531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:45.108942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0409e6-b99b-42b5-a652-55c6751ced66 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:45.113819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d320583-de6f-4b7e-8e18-a11091008f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:45.114439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d320583-de6f-4b7e-8e18-a11091008f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:45.114722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d320583-de6f-4b7e-8e18-a11091008f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:45.114992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d320583-de6f-4b7e-8e18-a11091008f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:45.115712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d320583-de6f-4b7e-8e18-a11091008f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:45.117320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d320583-de6f-4b7e-8e18-a11091008f45 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:45.130428 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1217/2409] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:18:45.134320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:45.144966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45e84-59ef-4235-ae67-4260f8739d71 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:45.150165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:45.150439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:45.150639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:45.150917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] PATH_INFO: `/v3/projects/91ee2e9768094d9fa2e84ab516a4dda4/users/c60b267ae5b64527b398c2adab3b691e/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:45.179555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ee2e9768094d9fa2e84ab516a4dda4, user_id=c60b267ae5b64527b398c2adab3b691e, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:45.182872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:45.198837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1193/2410] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:18:45 2022] PUT /identity/v3/projects/91ee2e9768094d9fa2e84ab516a4dda4/users/c60b267ae5b64527b398c2adab3b691e/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:18:45.210616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaad65f-a083-45cb-a66a-26965a42dfbf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:45.211078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaad65f-a083-45cb-a66a-26965a42dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:45.211297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaad65f-a083-45cb-a66a-26965a42dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:45.242318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-faaad65f-a083-45cb-a66a-26965a42dfbf None None] MFA Rules not processed for user `c60b267ae5b64527b398c2adab3b691e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:45.243451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-faaad65f-a083-45cb-a66a-26965a42dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:45.288289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:45.306141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1218/2411] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:45.318339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:45.320250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:45.342804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:45.385159 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a4831-be1f-4e4b-8ba5-cafe9aafe568 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:45.388785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:45.389383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:45.389659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:45.389928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:45.397968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:45.399417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:45.408518 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1194/2412] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:49.798907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a78ea-a502-41e3-85b8-ca38d231d1a2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:49.799352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a78ea-a502-41e3-85b8-ca38d231d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:49.799654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a78ea-a502-41e3-85b8-ca38d231d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:49.820758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-711a78ea-a502-41e3-85b8-ca38d231d1a2 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:49.821987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-711a78ea-a502-41e3-85b8-ca38d231d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:49.889488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1219/2413] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:49.922450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:49.924055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:50.001261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f039-c71e-454f-b9be-59abd261164a service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:50.008725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:50.009451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:50.009727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:50.010003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:50.019580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:50.021156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:50.030429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1195/2414] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:53.923687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f5e2-5973-4752-928e-0bc8a3bfec51 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:53.924203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f5e2-5973-4752-928e-0bc8a3bfec51 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:53.924324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f5e2-5973-4752-928e-0bc8a3bfec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:53.944380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-89e9f5e2-5973-4752-928e-0bc8a3bfec51 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:53.945619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-89e9f5e2-5973-4752-928e-0bc8a3bfec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:53.953905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1220/2415] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:53.979115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:53.990709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6dc1-b56b-427a-a388-db616394a82b service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:53.996185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:53.996716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:53.997057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:53.998428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:54.006113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:54.007756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:54.018703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1196/2416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:18:57.754405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ce916-9986-46e7-9cdb-80d10fb548be None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:57.755114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ce916-9986-46e7-9cdb-80d10fb548be None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:57.755114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ce916-9986-46e7-9cdb-80d10fb548be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:57.774557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-342ce916-9986-46e7-9cdb-80d10fb548be None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:57.775778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-342ce916-9986-46e7-9cdb-80d10fb548be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:57.831269 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1221/2417] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:57.843725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:57.845112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:57.915990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e89c5-6204-4721-8701-29abc2dd1c46 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:57.921821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:57.922456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:57.922747 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:57.923026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:57.932101 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:57.933689 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:57.942540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1197/2418] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:18:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:58.166500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a7a8-608d-4aad-bccc-19538baf68a8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:58.166765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a7a8-608d-4aad-bccc-19538baf68a8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:58.167055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a7a8-608d-4aad-bccc-19538baf68a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:58.204666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-20f7a7a8-608d-4aad-bccc-19538baf68a8 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:18:58.207084 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-20f7a7a8-608d-4aad-bccc-19538baf68a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:18:58.224481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1222/2419] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:18:58.441383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:18:58.460972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594afc0-5cf0-4e38-bdfb-048b6788ba54 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:18:58.467562 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:18:58.468385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:18:58.468864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:18:58.469324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:18:58.479306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:18:58.483548 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:18:58.505804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1198/2420] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:01.416848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:01.417472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:01.417472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:01.438650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:01.440286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:01.448559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1223/2421] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:19:01.477205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:01.488999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:01.494005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e59556-fc5b-48a4-ad27-753a0ae3f9a1 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:01.503099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9621-0a0a-4903-ab6b-34d2a7ffdd8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:01.503885 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9621-0a0a-4903-ab6b-34d2a7ffdd8d service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:01.504264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9621-0a0a-4903-ab6b-34d2a7ffdd8d service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:01.504557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9621-0a0a-4903-ab6b-34d2a7ffdd8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:01.515683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9621-0a0a-4903-ab6b-34d2a7ffdd8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:01.517272 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9621-0a0a-4903-ab6b-34d2a7ffdd8d service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:01.541765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1199/2422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:11.432616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=66 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:11.523535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:12.542789 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:12.552477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06825c8-18fa-4e6e-801e-c90e711ffc50 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:12.556885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:12.557501 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:12.557777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:12.558046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] PATH_INFO: `/v3/users/c60b267ae5b64527b398c2adab3b691e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:12.559201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60b267ae5b64527b398c2adab3b691e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:12.561131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:12.606206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60b267ae5b64527b398c2adab3b691e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:12.606846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60b267ae5b64527b398c2adab3b691e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:12.607466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60b267ae5b64527b398c2adab3b691e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:12.619522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60b267ae5b64527b398c2adab3b691e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:12.626994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60b267ae5b64527b398c2adab3b691e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:12.639589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1224/2423] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:19:12 2022] DELETE /identity/v3/users/c60b267ae5b64527b398c2adab3b691e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:12.644085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:12.644556 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:12.644667 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:12.663481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:12.664656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:12.723703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1200/2424] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:12.733592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:12.735034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:12.791791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a16df-20e5-4be1-bb42-17b8e8fc8d60 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:12.795355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb298b6f-f9a3-4506-8fae-5ba8f34d4578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:12.795958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298b6f-f9a3-4506-8fae-5ba8f34d4578 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:12.796237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298b6f-f9a3-4506-8fae-5ba8f34d4578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:12.796516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298b6f-f9a3-4506-8fae-5ba8f34d4578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:12.805262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb298b6f-f9a3-4506-8fae-5ba8f34d4578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:12.806689 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb298b6f-f9a3-4506-8fae-5ba8f34d4578 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:12.816377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1225/2425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:13.257283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.258798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:13.270891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77266ca-e39a-4aad-b328-16719e8cfa64 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.275510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.276144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.276427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.276798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] PATH_INFO: `/v3/projects/91ee2e9768094d9fa2e84ab516a4dda4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.277956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ee2e9768094d9fa2e84ab516a4dda4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.280042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.328351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ee2e9768094d9fa2e84ab516a4dda4', 'request_id': 'req-26816468-340d-4cfd-b786-0cf24b85b7f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:13.334402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ee2e9768094d9fa2e84ab516a4dda4', 'request_id': 'req-26816468-340d-4cfd-b786-0cf24b85b7f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:13.340703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ee2e9768094d9fa2e84ab516a4dda4', 'request_id': 'req-26816468-340d-4cfd-b786-0cf24b85b7f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:13.352789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] The token cache is being invalidate because project 91ee2e9768094d9fa2e84ab516a4dda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:19:13.353077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:13.353707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26816468-340d-4cfd-b786-0cf24b85b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:13.355233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1201/2426] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:19:13 2022] DELETE /identity/v3/projects/91ee2e9768094d9fa2e84ab516a4dda4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:13.360715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.360965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.361213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.380853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:13.382032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:13.446239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1226/2427] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:13.454304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.454591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.455355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.475264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:13.476477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:13.486624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1202/2428] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:13.490957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.508792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de61eb1-31ab-48a1-a3ed-9b3c17d1c1a9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.516767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.517815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.518325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.518810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.520150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:19:13.520711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.523847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.547866 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1227/2429] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:19:13.548998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.558551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991083e4-391b-46b0-8e5e-9c6a74c58e77 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.564310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.564917 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.565193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.565456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.566120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.568326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.598821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1203/2430] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:19:13 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:19:13.602959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.615931 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:13.621335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b24b-6b14-4511-835d-6dd314e8220e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.683628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.684248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.684530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.684805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.685454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.688207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.712796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1228/2431] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:19:13 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:19:13.715172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.727149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61fb0-97fb-47de-afe6-969f72a67d71 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.735675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.736395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.736674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.736949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.737674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.739698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.751054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1204/2432] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:19:13.754991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.765561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ee56f-0317-4238-9ed1-fafa68790699 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.770142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fc1e5-46b0-4ba7-9c3b-50a81493ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.770740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc1e5-46b0-4ba7-9c3b-50a81493ccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.771021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc1e5-46b0-4ba7-9c3b-50a81493ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.771332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc1e5-46b0-4ba7-9c3b-50a81493ccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.772020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fc1e5-46b0-4ba7-9c3b-50a81493ccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.773614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fc1e5-46b0-4ba7-9c3b-50a81493ccc9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.785532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1229/2433] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:19:13.789661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.801136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637fa19-0ba7-4f5e-9cf0-5478d470b198 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:13.805742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:13.806424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.806698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.806966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] PATH_INFO: `/v3/projects/b6651ce52ed74cc49cfc184e3f6fa181/users/d429a67a690341b9a03331f41b622e10/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.821560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6651ce52ed74cc49cfc184e3f6fa181, user_id=d429a67a690341b9a03331f41b622e10, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:13.824236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:13.836631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1205/2434] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:19:13 2022] PUT /identity/v3/projects/b6651ce52ed74cc49cfc184e3f6fa181/users/d429a67a690341b9a03331f41b622e10/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:13.848561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:13.848851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:13.849127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:13.880901 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] MFA Rules not processed for user `d429a67a690341b9a03331f41b622e10`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:13.882013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:13.945099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1230/2435] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:13.957001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:13.958678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:13.982475 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:14.028331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f53c7-2ae2-4386-ac68-911353f7de62 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:14.033003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed70f4-eb9f-4038-860a-8d2bf56bf921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:14.033692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed70f4-eb9f-4038-860a-8d2bf56bf921 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:14.033973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed70f4-eb9f-4038-860a-8d2bf56bf921 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:14.034239 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed70f4-eb9f-4038-860a-8d2bf56bf921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:14.043660 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed70f4-eb9f-4038-860a-8d2bf56bf921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:14.045342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed70f4-eb9f-4038-860a-8d2bf56bf921 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:14.056231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1206/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:14.081815 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:14.160067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e80a4-e6d9-4310-84a1-91f237e8767e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:14.165257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:14.166250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:14.166697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:14.167058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] PATH_INFO: `/v3/users/d429a67a690341b9a03331f41b622e10` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:14.168472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d429a67a690341b9a03331f41b622e10)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:14.170727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:14.187002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:14.243982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd429a67a690341b9a03331f41b622e10'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:14.244652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd429a67a690341b9a03331f41b622e10'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:14.245442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd429a67a690341b9a03331f41b622e10'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:14.262086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd429a67a690341b9a03331f41b622e10'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:14.278517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd429a67a690341b9a03331f41b622e10'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:14.307367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1231/2437] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:19:14 2022] DELETE /identity/v3/users/d429a67a690341b9a03331f41b622e10 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:14.312985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:14.313332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:14.313527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:14.354685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:14.356799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:14.427402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1207/2438] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:14.457336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:14.459468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:14.526812 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529cf8e-fe8c-44fe-b683-78ea9b72f0aa admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:14.530680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501410e-18b3-4a91-a6c8-55d2cc79cb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:14.531339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501410e-18b3-4a91-a6c8-55d2cc79cb8d service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:14.531635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501410e-18b3-4a91-a6c8-55d2cc79cb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:14.531884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501410e-18b3-4a91-a6c8-55d2cc79cb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:14.544289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501410e-18b3-4a91-a6c8-55d2cc79cb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:14.548078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501410e-18b3-4a91-a6c8-55d2cc79cb8d service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:14.565554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1232/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:15.230995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.233686 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:15.246301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f59cbb-4486-4c5d-b9f6-f3a0a4df8650 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.252490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.253138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.253425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.253700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] PATH_INFO: `/v3/projects/b6651ce52ed74cc49cfc184e3f6fa181` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.254990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6651ce52ed74cc49cfc184e3f6fa181)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.257622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.316584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6651ce52ed74cc49cfc184e3f6fa181', 'request_id': 'req-9c1c1406-6008-467a-86fe-7b1e404a21ba'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:15.322469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6651ce52ed74cc49cfc184e3f6fa181', 'request_id': 'req-9c1c1406-6008-467a-86fe-7b1e404a21ba'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:15.329698 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6651ce52ed74cc49cfc184e3f6fa181', 'request_id': 'req-9c1c1406-6008-467a-86fe-7b1e404a21ba'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:15.343242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] The token cache is being invalidate because project b6651ce52ed74cc49cfc184e3f6fa181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:19:15.343563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:15.344185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9c1c1406-6008-467a-86fe-7b1e404a21ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:15.345732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1208/2440] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:19:15 2022] DELETE /identity/v3/projects/b6651ce52ed74cc49cfc184e3f6fa181 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:15.406951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.407521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.407807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.427959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:15.429149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:15.487020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1233/2441] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:15.494497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.494778 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.495048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.515989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:15.517173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:15.524955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1209/2442] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:15.529161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.539653 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abd5ac-465e-4f4b-a8d3-e65817fa52d6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.544352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.544955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.545348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.545626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.546444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:19:15.546748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.548438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.559764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1234/2443] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:19:15.563999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.573488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd3cc0-8c3e-4b48-8d23-328278f33b33 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.578764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.579377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.579653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.579921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.580570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.582436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.609380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1210/2444] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:19:15 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:19:15.613470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.624037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839720-eb37-40fd-91b4-bf195aa2f8d7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.641598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:15.681672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.682287 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.682570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.682845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.683602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.685551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.712526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1235/2445] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:19:15 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:19:15.713765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.724444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde5e3-fcf6-4c5d-ab19-e1597bba65fc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.729023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.729625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.729905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.730173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.730851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.732465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.742891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1211/2446] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:19:15.747425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.759409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226007-ca51-41d5-83ff-2215561c92eb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.765156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dfb89-594a-457f-9d89-217d4bfba34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.765846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dfb89-594a-457f-9d89-217d4bfba34f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.766183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dfb89-594a-457f-9d89-217d4bfba34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.766549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dfb89-594a-457f-9d89-217d4bfba34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.767482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dfb89-594a-457f-9d89-217d4bfba34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.769218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dfb89-594a-457f-9d89-217d4bfba34f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.783783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1236/2447] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:19:15.784927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.796410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a4b95-95bc-45aa-9025-fc2fe986c689 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:15.801543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:15.802237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.802513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.802783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] PATH_INFO: `/v3/projects/ad637c4876f444c58c95ebff6d04f77e/users/62848e0e02244e04b3e4d75f3ba3a437/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.805391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:15.822590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad637c4876f444c58c95ebff6d04f77e, user_id=62848e0e02244e04b3e4d75f3ba3a437, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:15.825376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:15.839209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1212/2448] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:19:15 2022] PUT /identity/v3/projects/ad637c4876f444c58c95ebff6d04f77e/users/62848e0e02244e04b3e4d75f3ba3a437/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:15.849906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:15.850198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:15.850464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:15.879705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] MFA Rules not processed for user `62848e0e02244e04b3e4d75f3ba3a437`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:15.880898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:15.945686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1237/2449] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:15.956325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:15.957993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:16.015823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5083672-2886-4b56-9b7c-25303096c8ed admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:16.019387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:16.019993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:16.020271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:16.020540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:16.028743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:16.030812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:16.039595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1213/2450] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:17.279351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:17.280952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:17.332100 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:17.333848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:17.374098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075cef0-7809-4ea3-979f-7b542b1b45d9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:17.389658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:17.390295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:17.390570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:17.390841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:17.392743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:17.408807 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:17.411021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236796d6-e4d3-4b9a-b651-f91a2b18faf6 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:17.430651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551bd3e-d5ca-44e1-8f62-d2806e1ae850 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:17.436020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3f7ca-8595-4aa7-a302-b52117251661 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:17.436923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3f7ca-8595-4aa7-a302-b52117251661 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:17.437306 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3f7ca-8595-4aa7-a302-b52117251661 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:17.437838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3f7ca-8595-4aa7-a302-b52117251661 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:17.444365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1238/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:17.458124 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3f7ca-8595-4aa7-a302-b52117251661 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:17.460038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3f7ca-8595-4aa7-a302-b52117251661 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:17.488924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1214/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:19:19.534704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a02bf-6d7d-4679-b8f7-f6525d9b471e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:19.535243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a02bf-6d7d-4679-b8f7-f6525d9b471e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:19.535347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a02bf-6d7d-4679-b8f7-f6525d9b471e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:19.537119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1239/2453] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:19:19.544970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff888-5d49-4dea-ac98-3e18c1fd4eff None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:19.545454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff888-5d49-4dea-ac98-3e18c1fd4eff None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:19.545536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff888-5d49-4dea-ac98-3e18c1fd4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:19.572277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-da5ff888-5d49-4dea-ac98-3e18c1fd4eff None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:19.573419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-da5ff888-5d49-4dea-ac98-3e18c1fd4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:19.651353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1215/2454] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:19:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:19.663144 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a02bf-6d7d-4679-b8f7-f6525d9b471e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:19.665016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-285a02bf-6d7d-4679-b8f7-f6525d9b471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:19.685783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:19.726806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a02bf-6d7d-4679-b8f7-f6525d9b471e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:19.730333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755892ca-01b0-49d3-9012-87158ae5bd2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:19.730957 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755892ca-01b0-49d3-9012-87158ae5bd2a service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:19.731246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755892ca-01b0-49d3-9012-87158ae5bd2a service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:19.731526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755892ca-01b0-49d3-9012-87158ae5bd2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:19.741893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755892ca-01b0-49d3-9012-87158ae5bd2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:19.743373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755892ca-01b0-49d3-9012-87158ae5bd2a service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:19.757437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1240/2455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:19.829957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4033-3ebd-4f66-a641-d567c6302561 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:19.830163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4033-3ebd-4f66-a641-d567c6302561 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:19.830420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4033-3ebd-4f66-a641-d567c6302561 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:19.831806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1216/2456] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:19:19.836548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5db199-d1da-4c26-b42d-5cf0ada24c2b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:19.836831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5db199-d1da-4c26-b42d-5cf0ada24c2b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:19.837103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5db199-d1da-4c26-b42d-5cf0ada24c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:19.856123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3b5db199-d1da-4c26-b42d-5cf0ada24c2b None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:19.857333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3b5db199-d1da-4c26-b42d-5cf0ada24c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:19.909738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1241/2457] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:19:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:19.921606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4033-3ebd-4f66-a641-d567c6302561 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:19.924554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-990f4033-3ebd-4f66-a641-d567c6302561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:19.938598 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4033-3ebd-4f66-a641-d567c6302561 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:19.942134 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514684-3fe1-41c0-9a75-e7d5c20903ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:19.942985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514684-3fe1-41c0-9a75-e7d5c20903ab service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:19.943287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514684-3fe1-41c0-9a75-e7d5c20903ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:19.943559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514684-3fe1-41c0-9a75-e7d5c20903ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:19.947508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:19.952263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514684-3fe1-41c0-9a75-e7d5c20903ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:19.955013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514684-3fe1-41c0-9a75-e7d5c20903ab service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:19.963021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1217/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:20.046427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e0d9-07a7-4dd0-80c5-06e67a96d0c7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:20.046855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e0d9-07a7-4dd0-80c5-06e67a96d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:20.047510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e0d9-07a7-4dd0-80c5-06e67a96d0c7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:20.050165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1242/2459] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:19:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:19:20.056655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cca4-76be-4670-a500-33e6b2826b53 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:20.056945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cca4-76be-4670-a500-33e6b2826b53 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:20.057219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cca4-76be-4670-a500-33e6b2826b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:20.081407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9a63cca4-76be-4670-a500-33e6b2826b53 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:20.082527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a63cca4-76be-4670-a500-33e6b2826b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:20.092130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1218/2460] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:19:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:20.103413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17e0d9-07a7-4dd0-80c5-06e67a96d0c7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:20.105118 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d17e0d9-07a7-4dd0-80c5-06e67a96d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:20.124953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17e0d9-07a7-4dd0-80c5-06e67a96d0c7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:20.129672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:20.130291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:20.130559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:20.130846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:20.142294 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:20.143850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:20.155111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1243/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:22.713286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488f80-37f4-4813-b57d-9b21b9c61fd7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:22.713774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488f80-37f4-4813-b57d-9b21b9c61fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:22.714067 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488f80-37f4-4813-b57d-9b21b9c61fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:22.732498 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a2488f80-37f4-4813-b57d-9b21b9c61fd7 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:22.733712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2488f80-37f4-4813-b57d-9b21b9c61fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:22.791244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1219/2462] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:22.815248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:22.816773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:22.830111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:22.830702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:22.831006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:22.859581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] MFA Rules not processed for user `32403a3966f740c6b0a5319bcb3d9c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:22.859581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:22.902213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bee4d-5e93-42de-ba78-e0f89f9d16e9 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:22.907417 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d2fb-cbea-42dd-8219-23f3b7c0faad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:22.908154 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d2fb-cbea-42dd-8219-23f3b7c0faad service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:22.908436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d2fb-cbea-42dd-8219-23f3b7c0faad service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:22.908704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d2fb-cbea-42dd-8219-23f3b7c0faad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:22.917632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d2fb-cbea-42dd-8219-23f3b7c0faad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:22.919260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d2fb-cbea-42dd-8219-23f3b7c0faad service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:22.919864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1220/2463] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:19:22.933859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1244/2464] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:26.910946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:26.993989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e97b6-8c25-4d22-83f2-9d953373a439 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:26.999047 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:27.000524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:27.001519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:27.001955 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] PATH_INFO: `/v3/users/62848e0e02244e04b3e4d75f3ba3a437` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:27.003401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62848e0e02244e04b3e4d75f3ba3a437)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:27.005703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:27.064104 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:27.077210 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62848e0e02244e04b3e4d75f3ba3a437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.091976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62848e0e02244e04b3e4d75f3ba3a437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.093258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62848e0e02244e04b3e4d75f3ba3a437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.103739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62848e0e02244e04b3e4d75f3ba3a437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.113113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62848e0e02244e04b3e4d75f3ba3a437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.133233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1221/2465] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:19:26 2022] DELETE /identity/v3/users/62848e0e02244e04b3e4d75f3ba3a437 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:27.137969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:27.138643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:27.138979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:27.183273 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:27.184538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:27.252785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:27.291628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1245/2466] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:27.300285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:27.301907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:27.387910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18be7bd-188a-4346-b06c-54028beebb5a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:27.392223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209c57-1dd7-41d6-9f39-ea5bf7a723d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:27.392842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209c57-1dd7-41d6-9f39-ea5bf7a723d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:27.393126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209c57-1dd7-41d6-9f39-ea5bf7a723d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:27.393401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209c57-1dd7-41d6-9f39-ea5bf7a723d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:27.403355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209c57-1dd7-41d6-9f39-ea5bf7a723d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:27.404799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209c57-1dd7-41d6-9f39-ea5bf7a723d5 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:27.415411 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1222/2467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:27.707875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:27.709301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:27.721600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5e559-0f85-4e36-b2e1-e8ae47542ce4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:27.728334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:27.741445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:27.742636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:27.743122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] PATH_INFO: `/v3/projects/ad637c4876f444c58c95ebff6d04f77e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:27.745351 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad637c4876f444c58c95ebff6d04f77e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:27.748296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:27.808628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad637c4876f444c58c95ebff6d04f77e', 'request_id': 'req-0254c6f7-68f6-4212-9b01-876a1ee88ffd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.814394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad637c4876f444c58c95ebff6d04f77e', 'request_id': 'req-0254c6f7-68f6-4212-9b01-876a1ee88ffd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.821412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad637c4876f444c58c95ebff6d04f77e', 'request_id': 'req-0254c6f7-68f6-4212-9b01-876a1ee88ffd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.835700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] The token cache is being invalidate because project ad637c4876f444c58c95ebff6d04f77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:19:27.836002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.836774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:19:27.838656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1246/2468] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:19:27 2022] DELETE /identity/v3/projects/ad637c4876f444c58c95ebff6d04f77e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:19:37.410826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=5,keystone:SELECT=40,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:37.832064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:39.526877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4a3a-403e-47a0-9333-7f5162fe0e77 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:39.527415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4a3a-403e-47a0-9333-7f5162fe0e77 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:39.527499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4a3a-403e-47a0-9333-7f5162fe0e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:39.547602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bfbe4a3a-403e-47a0-9333-7f5162fe0e77 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:39.549682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bfbe4a3a-403e-47a0-9333-7f5162fe0e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:39.604233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1223/2469] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:39.616853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:39.618229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:39.685771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254c6f7-68f6-4212-9b01-876a1ee88ffd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:39.691423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:39.692022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:39.692562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:39.692829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:39.700659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:39.702245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:39.710457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1247/2470] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:19:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:48.651229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2161-e89e-4d33-be19-30964c33fa5f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:48.651739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2161-e89e-4d33-be19-30964c33fa5f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:48.651838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2161-e89e-4d33-be19-30964c33fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:48.671653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-461f2161-e89e-4d33-be19-30964c33fa5f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:48.672831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-461f2161-e89e-4d33-be19-30964c33fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:48.735374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1224/2471] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:48.765421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:48.766831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:48.839439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c2783-01b0-45e2-9759-f73e9032bf51 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:48.844735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:48.845339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:48.846310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:48.846590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:48.854598 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:48.856211 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:48.865342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1248/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:51.899254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9e72d-b1b4-43a8-b0a8-f7b2d7a9c0f5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:51.899781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9e72d-b1b4-43a8-b0a8-f7b2d7a9c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:51.899899 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9e72d-b1b4-43a8-b0a8-f7b2d7a9c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:51.918906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6bc9e72d-b1b4-43a8-b0a8-f7b2d7a9c0f5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:51.920132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6bc9e72d-b1b4-43a8-b0a8-f7b2d7a9c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:51.928515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1225/2473] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:51.953037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:51.954582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:51.969994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441da4e-6a65-4e15-9df0-e22fc4571ff7 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:51.975413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:51.976013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:51.976291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:51.976562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:51.984477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:51.986061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:51.996493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1249/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:54.969082 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaae077-8b74-426f-8879-075c380f9f10 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:54.969565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaae077-8b74-426f-8879-075c380f9f10 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:54.969659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaae077-8b74-426f-8879-075c380f9f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:54.992594 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-afaae077-8b74-426f-8879-075c380f9f10 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:54.993798 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-afaae077-8b74-426f-8879-075c380f9f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:55.001544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1226/2475] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:55.027173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:55.042394 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f1e8-fa58-4033-8e0c-7b6db5db5124 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:55.050171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:55.050784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:55.051059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:55.051355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:55.059895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:55.061466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:55.071220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1250/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:19:58.121560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e446d-76f1-4d52-a975-db4ca025397a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:58.122048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e446d-76f1-4d52-a975-db4ca025397a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:58.122145 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e446d-76f1-4d52-a975-db4ca025397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:58.143074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-011e446d-76f1-4d52-a975-db4ca025397a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:19:58.144419 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-011e446d-76f1-4d52-a975-db4ca025397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:19:58.152355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1227/2477] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:19:58.175790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:19:58.187039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4f95e-0dc7-49d2-807d-c1fe19c60944 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:19:58.193290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:19:58.193888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:19:58.194172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:19:58.194446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:19:58.202461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:19:58.204078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:19:58.214281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1251/2478] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:20:02.301478 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73bf67-2d77-4c64-a610-6fa00b330671 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:02.302016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73bf67-2d77-4c64-a610-6fa00b330671 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:02.302016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73bf67-2d77-4c64-a610-6fa00b330671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:02.322654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4c73bf67-2d77-4c64-a610-6fa00b330671 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:20:02.323863 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4c73bf67-2d77-4c64-a610-6fa00b330671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:02.332083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1228/2479] 10.222.0.15 () {58 vars in 1016 bytes} [Fri Aug 5 05:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:20:02.356023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:02.367024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f392-1917-4fb2-a106-e1375e24657d service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:02.372362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c79080-36fc-4a8d-a819-f10a253adc74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:02.372955 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c79080-36fc-4a8d-a819-f10a253adc74 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:02.373231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c79080-36fc-4a8d-a819-f10a253adc74 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:02.373500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c79080-36fc-4a8d-a819-f10a253adc74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:02.381776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c79080-36fc-4a8d-a819-f10a253adc74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:02.383367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c79080-36fc-4a8d-a819-f10a253adc74 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:02.392891 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1252/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:20:12.315833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=64 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:12.388453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:13.495828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298061cf-4b03-4237-a2be-1f1dcaa362d7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:13.496292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298061cf-4b03-4237-a2be-1f1dcaa362d7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:13.496511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298061cf-4b03-4237-a2be-1f1dcaa362d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:13.517348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-298061cf-4b03-4237-a2be-1f1dcaa362d7 None None] MFA Rules not processed for user `386a456c559546bcbecc0181ce656a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:20:13.518542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-298061cf-4b03-4237-a2be-1f1dcaa362d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:13.574224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1229/2481] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:20:15.943570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55f8d-048f-4604-9799-55713abd3836 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:15.944402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55f8d-048f-4604-9799-55713abd3836 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:15.944854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55f8d-048f-4604-9799-55713abd3836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:15.964875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f6e55f8d-048f-4604-9799-55713abd3836 None None] MFA Rules not processed for user `20bd2f5da95a4d029adbe7b1e0f75bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:20:15.966267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f6e55f8d-048f-4604-9799-55713abd3836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:16.035388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1253/2482] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:20:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:20:23.567889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=25 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:26.028298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=25 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:31.697379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:31.697943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:31.698072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:31.719907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] MFA Rules not processed for user `b16a98ac368c405f93dc3c21c9d28834`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:20:31.721109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:31.777138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1230/2483] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:20:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:20:35.004498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a56098-885b-4016-bf2f-372f0bf90e99 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:35.005027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a56098-885b-4016-bf2f-372f0bf90e99 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:35.005146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a56098-885b-4016-bf2f-372f0bf90e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:35.025921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-94a56098-885b-4016-bf2f-372f0bf90e99 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:20:35.027239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-94a56098-885b-4016-bf2f-372f0bf90e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:35.034795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1254/2484] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 05:20:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:20:35.060474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:35.073974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465aae0-fdb9-4335-aa05-bea815bc3df9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:35.080020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bfe8f-e85e-4748-9f1d-d4285e796974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:35.080713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfe8f-e85e-4748-9f1d-d4285e796974 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:35.081064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfe8f-e85e-4748-9f1d-d4285e796974 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:35.081407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfe8f-e85e-4748-9f1d-d4285e796974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:35.090321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bfe8f-e85e-4748-9f1d-d4285e796974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:35.092039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bfe8f-e85e-4748-9f1d-d4285e796974 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:35.101060 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1231/2485] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 05:20:35.802503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2aa31-fa7e-407f-bd32-0446ca5b0240 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:35.802839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2aa31-fa7e-407f-bd32-0446ca5b0240 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:35.803168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2aa31-fa7e-407f-bd32-0446ca5b0240 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:35.804546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1255/2486] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:20:35.820270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:35.820483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:35.820741 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:35.848874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] MFA Rules not processed for user `5402629299ee411d988f130f03dbcfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:20:35.850355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:35.871730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2aa31-fa7e-407f-bd32-0446ca5b0240 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:35.876115 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-abf2aa31-fa7e-407f-bd32-0446ca5b0240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:35.903512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2aa31-fa7e-407f-bd32-0446ca5b0240 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:35.910212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:35.911105 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:35.911436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:35.911734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] PATH_INFO: `/v3/users/32403a3966f740c6b0a5319bcb3d9c05` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:35.913111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32403a3966f740c6b0a5319bcb3d9c05)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:35.915068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:35.970115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1232/2487] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:20:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:20:35.977297 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32403a3966f740c6b0a5319bcb3d9c05'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:35.977993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32403a3966f740c6b0a5319bcb3d9c05'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:35.978589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32403a3966f740c6b0a5319bcb3d9c05'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:35.989836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:35.996096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:35.998967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32403a3966f740c6b0a5319bcb3d9c05'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.013152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32403a3966f740c6b0a5319bcb3d9c05'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.014826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28780-d0b6-491e-b4f8-cc36c20ed13b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:36.022157 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:36.023006 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:36.023497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:36.023763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:36.025742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:36.029376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1256/2488] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:20:35 2022] DELETE /identity/v3/users/32403a3966f740c6b0a5319bcb3d9c05 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:20:36.040604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:36.042397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:36.055213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1233/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:20:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:20:36.224033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:36.225913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:36.305932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb814f-36ec-4535-b67b-3466ed9127b0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:36.310685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:36.311375 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:36.311662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:36.311939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] PATH_INFO: `/v3/projects/d6cfe15028dd44bd974a1294eba8f404` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:36.313638 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cfe15028dd44bd974a1294eba8f404)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:36.315627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:36.364997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cfe15028dd44bd974a1294eba8f404', 'request_id': 'req-6fdb6074-d4e6-4351-a791-803706ddd604'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.370710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cfe15028dd44bd974a1294eba8f404', 'request_id': 'req-6fdb6074-d4e6-4351-a791-803706ddd604'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.377646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cfe15028dd44bd974a1294eba8f404', 'request_id': 'req-6fdb6074-d4e6-4351-a791-803706ddd604'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.382407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:36.393341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] The token cache is being invalidate because project d6cfe15028dd44bd974a1294eba8f404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:20:36.393778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.394455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:36.396563 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1257/2490] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:20:36 2022] DELETE /identity/v3/projects/d6cfe15028dd44bd974a1294eba8f404 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:20:42.928386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:42.930233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:42.946626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e0f8e-6b38-4cbd-b798-0759e6f4fa12 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:43.003998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:43.004557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:43.004837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:43.005127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] PATH_INFO: `/v3/users/fcf158775e4048e6889f5c7b54e99706` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:43.006286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf158775e4048e6889f5c7b54e99706)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:43.008218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:43.024352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:43.055585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf158775e4048e6889f5c7b54e99706'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.056202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf158775e4048e6889f5c7b54e99706'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.056794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf158775e4048e6889f5c7b54e99706'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.064297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf158775e4048e6889f5c7b54e99706'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.071412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf158775e4048e6889f5c7b54e99706'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.089730 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1234/2491] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:20:42 2022] DELETE /identity/v3/users/fcf158775e4048e6889f5c7b54e99706 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:20:43.262271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:43.263744 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:43.279203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6074-d4e6-4351-a791-803706ddd604 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:43.340427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:43.341100 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:43.341381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:43.341747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] PATH_INFO: `/v3/projects/b1fec5f30ec4497eb4e04c6f4a202180` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:43.342918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fec5f30ec4497eb4e04c6f4a202180)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:43.343054 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:43.344974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:43.345341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:43.397416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fec5f30ec4497eb4e04c6f4a202180', 'request_id': 'req-4a5cdf71-033a-4a5e-818f-58dca869532b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.403142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fec5f30ec4497eb4e04c6f4a202180', 'request_id': 'req-4a5cdf71-033a-4a5e-818f-58dca869532b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.410381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf2e3a-a75e-49e2-8705-3df515392da5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:43.410600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fec5f30ec4497eb4e04c6f4a202180', 'request_id': 'req-4a5cdf71-033a-4a5e-818f-58dca869532b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.424897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] The token cache is being invalidate because project b1fec5f30ec4497eb4e04c6f4a202180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:20:43.425185 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.425803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.427481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1258/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:20:43 2022] DELETE /identity/v3/projects/b1fec5f30ec4497eb4e04c6f4a202180 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:20:43.431676 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:43.433064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:43.462577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:43.463202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:43.463482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:43.463751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:43.465469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:43.498987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cdf71-033a-4a5e-818f-58dca869532b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:43.504423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:43.505106 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:43.505446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:43.505663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] PATH_INFO: `/v3/users/c043ad0f840e4ce2b4ec36a0425f560f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:43.507064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c043ad0f840e4ce2b4ec36a0425f560f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:43.509372 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:43.534203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:43.541230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:43.560736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:43.562700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:43.565877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c043ad0f840e4ce2b4ec36a0425f560f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.566803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c043ad0f840e4ce2b4ec36a0425f560f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.567509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c043ad0f840e4ce2b4ec36a0425f560f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.576939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1235/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:20:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:20:43.582284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c043ad0f840e4ce2b4ec36a0425f560f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.590349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c043ad0f840e4ce2b4ec36a0425f560f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.606152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1259/2494] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:20:43 2022] DELETE /identity/v3/users/c043ad0f840e4ce2b4ec36a0425f560f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:20:43.783780 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:43.794590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997da2-dbe8-49e5-a30d-b6841afc90d8 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:43.855052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:43.855725 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:43.856007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:43.856280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] PATH_INFO: `/v3/projects/5b5e9afa46c6401288cb3e747e03e8d8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:43.857427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5e9afa46c6401288cb3e747e03e8d8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:43.859625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:43.907574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5e9afa46c6401288cb3e747e03e8d8', 'request_id': 'req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.912987 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5e9afa46c6401288cb3e747e03e8d8', 'request_id': 'req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.918974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5e9afa46c6401288cb3e747e03e8d8', 'request_id': 'req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.931333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] The token cache is being invalidate because project 5b5e9afa46c6401288cb3e747e03e8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:20:43.931969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.932282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:20:43.933797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1236/2495] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:20:43 2022] DELETE /identity/v3/projects/5b5e9afa46c6401288cb3e747e03e8d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:20:44.774098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:20:44.775605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:44.831973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ce2b-35e1-4ae0-b6ea-f9ec41bbf681 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:20:44.880883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:20:44.881488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:20:44.881769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:20:44.882036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:20:44.883777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:20:44.953000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:20:44.954425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:20:44.965414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1260/2496] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:20:53.928292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:54.960369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:01.771491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:01.772982 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:01.789926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1b95d-2ba5-4a1f-8ea1-1b4b7f0b7f17 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:01.795357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:01.795960 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:01.796241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:01.796514 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:01.798612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:01.857681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:01.859319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:01.868459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1237/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:07.418492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:07.419996 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:07.434162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fae99-cce4-4a22-9f45-b5bc319dcdd4 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:07.439794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:07.440361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:07.440634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:07.440902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:07.442878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:07.500647 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:07.502251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:07.511188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1261/2498] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:11.864282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=28 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:17.507019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=28 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:18.551645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:18.563268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28207557-6d9a-4cbe-9e8f-82eaf8c3bf48 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:18.569510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:18.570115 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:18.570579 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:18.571013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:18.572961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:18.586043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:18.587636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:18.598198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1238/2499] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:20.259395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:20.261419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:20.274899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18d9d-6c2d-46e3-8d0d-668e8213c13b service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:20.278721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:20.279444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:20.279809 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:20.280092 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:20.282565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:20.347919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:20.349402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:20.359548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1262/2500] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:23.644046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:23.644046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:23.715004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:23.716678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:23.728785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da065-239e-4184-8522-855d3e97fea4 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:23.735032 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:23.735774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:23.736062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:23.736350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:23.736694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1279-bb4d-4602-88c1-4784ad2eaff0 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:23.739678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:23.742136 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:23.742782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:23.743061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:23.743528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] PATH_INFO: `/v3/users/20bd2f5da95a4d029adbe7b1e0f75bc3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:23.744827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bd2f5da95a4d029adbe7b1e0f75bc3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:23.746939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:23.752880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:23.754532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:23.765804 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1239/2501] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:21:23.808805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bd2f5da95a4d029adbe7b1e0f75bc3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:23.809646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bd2f5da95a4d029adbe7b1e0f75bc3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:23.810329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bd2f5da95a4d029adbe7b1e0f75bc3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:23.825709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bd2f5da95a4d029adbe7b1e0f75bc3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:23.834780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d3b66724-4444-4eec-8161-e467e2f6edfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bd2f5da95a4d029adbe7b1e0f75bc3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:23.848020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1263/2502] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:23 2022] DELETE /identity/v3/users/20bd2f5da95a4d029adbe7b1e0f75bc3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:24.022496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.033935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f25d0-5c6e-4488-abac-4b68dd2e21bf service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.091905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.092542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.092823 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.093096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] PATH_INFO: `/v3/projects/18b368a852434624a3a44cd80628aef6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.094517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b368a852434624a3a44cd80628aef6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.096449 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.144087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b368a852434624a3a44cd80628aef6', 'request_id': 'req-e032d0bb-d1d8-432c-ac81-0300020791c1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:24.149461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b368a852434624a3a44cd80628aef6', 'request_id': 'req-e032d0bb-d1d8-432c-ac81-0300020791c1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:24.155426 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b368a852434624a3a44cd80628aef6', 'request_id': 'req-e032d0bb-d1d8-432c-ac81-0300020791c1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:24.167523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] The token cache is being invalidate because project 18b368a852434624a3a44cd80628aef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:21:24.168133 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:24.171495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e032d0bb-d1d8-432c-ac81-0300020791c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:24.173830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1240/2503] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:21:24 2022] DELETE /identity/v3/projects/18b368a852434624a3a44cd80628aef6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:24.179338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537621f-4311-46fd-8655-805e206b8835 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.179620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537621f-4311-46fd-8655-805e206b8835 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.179896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537621f-4311-46fd-8655-805e206b8835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.199984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7537621f-4311-46fd-8655-805e206b8835 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:24.201162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7537621f-4311-46fd-8655-805e206b8835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:24.260175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1264/2504] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:24.268045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.268263 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.268536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.283393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:24.290095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:24.292380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:24.302007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1241/2505] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:24.306340 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537621f-4311-46fd-8655-805e206b8835 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.316671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537621f-4311-46fd-8655-805e206b8835 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.321376 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.321987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.322267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.322538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.323271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:21:24.323576 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.325181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.326721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:24.338860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1265/2506] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:21:24.343049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.353043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83532c-6671-409a-9686-fef822ef95cf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.357691 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.358287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.358564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.358833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.360130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.362016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.388196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1242/2507] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:21:24 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:24.392353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.402741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f853c-3857-407d-9386-ebe330f588f5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.457145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.457753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.458029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.458299 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.458949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.460889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.481781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1266/2508] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:21:24 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:24.486510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.497053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe6824-2f5b-4757-a8b5-32a7369abb6a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.501681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.502279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.502554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.502822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.503543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.505113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.515048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1243/2509] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:24.519386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.529161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9f2ee-9e14-43f5-b62f-16b4703879ab admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.534371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18238d4-27bf-4111-b63a-d4c7c2bcb501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.534970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18238d4-27bf-4111-b63a-d4c7c2bcb501 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.535288 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18238d4-27bf-4111-b63a-d4c7c2bcb501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.535595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18238d4-27bf-4111-b63a-d4c7c2bcb501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.536306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18238d4-27bf-4111-b63a-d4c7c2bcb501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.537909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18238d4-27bf-4111-b63a-d4c7c2bcb501 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.549382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1267/2510] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:24.553582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.563668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754e1da-ca18-43ba-9585-4f380bb5eef9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.568535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.569180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.569462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.569736 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] PATH_INFO: `/v3/projects/e2fb243acf584b9dbdef8109649bcb89/users/2fa0149b879941fc8b9223ec0c4c81ce/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.584325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fb243acf584b9dbdef8109649bcb89, user_id=2fa0149b879941fc8b9223ec0c4c81ce, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.586974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.600532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1244/2511] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:24 2022] PUT /identity/v3/projects/e2fb243acf584b9dbdef8109649bcb89/users/2fa0149b879941fc8b9223ec0c4c81ce/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:24.605967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14de931-9554-4488-9f0c-1f9fd267ee59 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.606260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14de931-9554-4488-9f0c-1f9fd267ee59 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.606589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14de931-9554-4488-9f0c-1f9fd267ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.626049 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f14de931-9554-4488-9f0c-1f9fd267ee59 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:24.627317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f14de931-9554-4488-9f0c-1f9fd267ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:24.686910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1268/2512] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:24.697353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:24.699103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:24.758543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4be1a2-075a-4ccb-b85c-e0297c13563d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:24.762357 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:24.763042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:24.763432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:24.763779 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:24.774492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:24.775887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:24.786053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1245/2513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:21:30.030758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5313-658e-4172-8ba4-32dad322d9d2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:30.031951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5313-658e-4172-8ba4-32dad322d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:30.032167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5313-658e-4172-8ba4-32dad322d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:30.060775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cc5e5313-658e-4172-8ba4-32dad322d9d2 None None] MFA Rules not processed for user `2fa0149b879941fc8b9223ec0c4c81ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:30.062014 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cc5e5313-658e-4172-8ba4-32dad322d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:30.134400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1269/2514] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:30.151480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:30.152964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:30.229837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b74af6-d62c-4f98-a62f-b5334f36347b service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:30.235410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:30.236018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:30.236301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:30.236569 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:30.244346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:30.245929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:30.255293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1246/2515] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:31.603072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:31.603517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:31.603660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:31.612124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:31.628271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] MFA Rules not processed for user `2fa0149b879941fc8b9223ec0c4c81ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:31.629763 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:31.637725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1270/2516] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:31.990453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:31.991935 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:32.004566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7bf5f-b092-4742-90dd-37f55b84bc92 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:32.008350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:32.008953 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:32.009237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:32.009567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:32.011345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:32.022505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:32.024219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:32.033243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1247/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:32.413708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:32.415694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:32.530066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d373-d197-4392-b6c9-70df70f526c4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:32.536387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:32.537221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:32.537317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:32.537572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:32.539437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:32.552442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:32.554152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:32.565505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1271/2518] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:33.377280 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:33.386293 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d209-3a59-4847-92a7-218d2f3d6b2a service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:33.389929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:33.390557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:33.390840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:33.391131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:33.392878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:33.406540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:33.408195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:33.419881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1248/2519] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:35.334455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:35.345240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557570-fcf2-40ac-bd61-30351d11554b service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:35.351365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:35.352201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:35.352332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:35.352525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:35.354319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:35.367188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:35.368649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:35.379251 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1272/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:37.663682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:37.665207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:37.674477 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:37.679053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243666e4-7510-425a-859c-5d76fab4d141 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:37.685118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:37.685758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:37.686035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:37.686308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] PATH_INFO: `/v3/users/386a456c559546bcbecc0181ce656a30` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:37.688268 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] RBAC: Authorizing `identity:delete_user(user_id=386a456c559546bcbecc0181ce656a30)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:37.690186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:37.748975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386a456c559546bcbecc0181ce656a30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:37.750439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386a456c559546bcbecc0181ce656a30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:37.751089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386a456c559546bcbecc0181ce656a30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:37.759743 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386a456c559546bcbecc0181ce656a30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:37.767454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cdfacac5-2308-4684-9f5e-686bdaed454a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386a456c559546bcbecc0181ce656a30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:37.786716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1249/2521] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:37 2022] DELETE /identity/v3/users/386a456c559546bcbecc0181ce656a30 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:37.983050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.000523 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c94a-e595-49cf-b950-714cd911f51a service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.094747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.095841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.096274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.096557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] PATH_INFO: `/v3/projects/96ea99a4a8ba4249a26a0c5aed967655` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.098350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ea99a4a8ba4249a26a0c5aed967655)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.100366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.161098 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ea99a4a8ba4249a26a0c5aed967655', 'request_id': 'req-9d25e532-6a90-4ade-a21c-19fe416c6786'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:38.168163 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ea99a4a8ba4249a26a0c5aed967655', 'request_id': 'req-9d25e532-6a90-4ade-a21c-19fe416c6786'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:38.179962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ea99a4a8ba4249a26a0c5aed967655', 'request_id': 'req-9d25e532-6a90-4ade-a21c-19fe416c6786'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:38.193089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] The token cache is being invalidate because project 96ea99a4a8ba4249a26a0c5aed967655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:21:38.193699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:38.194599 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9d25e532-6a90-4ade-a21c-19fe416c6786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:38.196122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1273/2522] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:21:37 2022] DELETE /identity/v3/projects/96ea99a4a8ba4249a26a0c5aed967655 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:38.201338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.201695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.202044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.225311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:38.226700 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:38.302248 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1250/2523] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:21:38.309885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.310255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.310627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.322357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:38.343944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:38.345175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:38.354831 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1274/2524] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:38.359793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.369896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8a76-dacd-4c3a-9b11-57afd5ac71c7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.375880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.376648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.377034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.377437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.378255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:21:38.379020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.380440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.396441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1251/2525] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:21:38.400932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.412164 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786eaf-3fdd-4acc-829e-0133c6992edc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.423994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.424631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.424908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.425178 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.425858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.427810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.463114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1275/2526] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:21:38 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:38.466585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.478992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dacd9d-4570-486e-84c2-63320112c4c9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.544894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.545536 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.545814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.546117 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.548098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.550128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.561442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:38.582734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1252/2527] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:21:38 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:21:38.588339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.605126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737eeb-5f1d-4f14-8c75-b2cade9a1139 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.612695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.613343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.613618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.613882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.614570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.616589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.633348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1276/2528] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:38.634733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.647609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387b98c-0a3f-43e2-baf5-b455b28bd22f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.652520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31559a3b-fde9-48af-8a48-b8b4326a9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.653126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31559a3b-fde9-48af-8a48-b8b4326a9a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.653403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31559a3b-fde9-48af-8a48-b8b4326a9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.653675 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31559a3b-fde9-48af-8a48-b8b4326a9a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.654361 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31559a3b-fde9-48af-8a48-b8b4326a9a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.656048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31559a3b-fde9-48af-8a48-b8b4326a9a83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.667510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1253/2529] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:38.672124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.682495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2370a-342e-4873-9064-f70996bdb275 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.692503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.693242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.693565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.693883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] PATH_INFO: `/v3/projects/173dac79e0d540b4840d38931b5965d4/users/a9bc1321bdff4cff8c066a20c85f7743/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.713397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173dac79e0d540b4840d38931b5965d4, user_id=a9bc1321bdff4cff8c066a20c85f7743, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.716190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.729754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1277/2530] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:38 2022] PUT /identity/v3/projects/173dac79e0d540b4840d38931b5965d4/users/a9bc1321bdff4cff8c066a20c85f7743/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:38.739891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f47eea-17dc-4d6a-bd07-b7a1d50917b2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.740181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f47eea-17dc-4d6a-bd07-b7a1d50917b2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.740457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f47eea-17dc-4d6a-bd07-b7a1d50917b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.776786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d2f47eea-17dc-4d6a-bd07-b7a1d50917b2 None None] MFA Rules not processed for user `a9bc1321bdff4cff8c066a20c85f7743`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:38.778230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d2f47eea-17dc-4d6a-bd07-b7a1d50917b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:38.858945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1254/2531] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:38.870680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:38.872519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:38.935538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0894a-b1a6-48d2-87cf-08d43b57f586 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:38.939956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:38.940595 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.941156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.941425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:38.950412 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:38.951857 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:38.962509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1278/2532] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:38.990018 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:38.990312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:38.990592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:39.011318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:39.012521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:39.072461 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1255/2533] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:39.126624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:39.128076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:39.234721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f3ef-15e1-45fe-ba96-ff196a42ecc3 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:39.253393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:39.254032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:39.254310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:39.254578 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:39.275890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:39.277570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:39.288928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1279/2534] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:21:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:21:39.487453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:39.488655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:39.686783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a76f5-a83a-4685-a789-c3f58eedfae8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:39.695550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:39.696380 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:39.696828 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:39.697284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:39.699305 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:39.714343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:39.716560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:39.730045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1256/2535] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:21:45.985597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:45.999558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bd5bd-bf7f-4d85-832f-6b03dca55ea7 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:46.006997 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:46.007855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:46.008165 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:46.008438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:46.011886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:46.025526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:46.027198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c9259-e5ca-406a-afc6-298613d85a2f service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:46.046183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1280/2536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:48.048848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:48.053787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:48.126812 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc2fc-f899-4898-80e5-3677e7455079 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:48.132769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:48.133441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:48.133813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:48.134094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] PATH_INFO: `/v3/users/a9bc1321bdff4cff8c066a20c85f7743` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:48.135297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bc1321bdff4cff8c066a20c85f7743)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:48.137237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:48.226914 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bc1321bdff4cff8c066a20c85f7743'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.227576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bc1321bdff4cff8c066a20c85f7743'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.229429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bc1321bdff4cff8c066a20c85f7743'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.243300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bc1321bdff4cff8c066a20c85f7743'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.252297 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bc1321bdff4cff8c066a20c85f7743'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.275390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1257/2537] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:48 2022] DELETE /identity/v3/users/a9bc1321bdff4cff8c066a20c85f7743 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:48.277384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc1268-ba90-4654-9a30-363655745014 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:48.278230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc1268-ba90-4654-9a30-363655745014 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:48.278611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc1268-ba90-4654-9a30-363655745014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:48.301282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-78bc1268-ba90-4654-9a30-363655745014 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:48.302654 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-78bc1268-ba90-4654-9a30-363655745014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:48.320754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:48.380193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1281/2538] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:48.391096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:48.392789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:48.471925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee414d8-335f-47bb-b26a-a3fbb09eea7e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:48.475718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6d4b-122a-40b2-a494-42b36d9c3263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:48.477178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6d4b-122a-40b2-a494-42b36d9c3263 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:48.477800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6d4b-122a-40b2-a494-42b36d9c3263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:48.478423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6d4b-122a-40b2-a494-42b36d9c3263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:48.489934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6d4b-122a-40b2-a494-42b36d9c3263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:48.491968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6d4b-122a-40b2-a494-42b36d9c3263 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:48.505038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1258/2539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:21:48.815350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc1268-ba90-4654-9a30-363655745014 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:48.817353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-78bc1268-ba90-4654-9a30-363655745014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:48.840555 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc1268-ba90-4654-9a30-363655745014 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:48.846556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:48.847254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:48.847534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:48.847810 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] PATH_INFO: `/v3/projects/173dac79e0d540b4840d38931b5965d4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:48.849143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173dac79e0d540b4840d38931b5965d4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:48.851066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:48.903379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173dac79e0d540b4840d38931b5965d4', 'request_id': 'req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.909380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173dac79e0d540b4840d38931b5965d4', 'request_id': 'req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.916542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173dac79e0d540b4840d38931b5965d4', 'request_id': 'req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.929967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] The token cache is being invalidate because project 173dac79e0d540b4840d38931b5965d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:21:48.930240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.930869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e5a2e78-d2d7-4ca7-8eed-8ead51e37314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:48.932388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1282/2540] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:21:48 2022] DELETE /identity/v3/projects/173dac79e0d540b4840d38931b5965d4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:48.938230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:48.938520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:48.938794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:48.958043 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:48.959266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:48.977577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:49.021114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1259/2541] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:49.028928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.029213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.029508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.050002 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:49.051213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:49.058876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1283/2542] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:49.063458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.073346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4a74-2723-4d61-8d67-2629f6d087a1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.078310 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.079010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.079418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.079802 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.080592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:21:49.080996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.082690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.095086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1260/2543] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:21:49.099524 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.109064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa61a-1871-4baa-9fff-7cd19b8c115a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.113785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.114408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.114681 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.114946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.115632 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.117515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.143517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1284/2544] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:49.147763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.158316 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3681d1-301b-40be-a20f-a7c5f70fae96 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.216283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.216895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.217178 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.217452 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.218617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.220582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.242017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1261/2545] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:49.246319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.256792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2ac1-34ca-4ef6-a2d0-8625535f2baa admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.263315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.263977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.264258 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.264963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.265800 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.267445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.277535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1285/2546] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:49.282298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.294366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34835a6-f702-47a8-bae3-25ff797cc9c6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.300596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65861a4-c85c-4a54-9c09-b1c8b1f6a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.301288 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65861a4-c85c-4a54-9c09-b1c8b1f6a1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.301507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65861a4-c85c-4a54-9c09-b1c8b1f6a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.301782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65861a4-c85c-4a54-9c09-b1c8b1f6a1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.302621 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65861a4-c85c-4a54-9c09-b1c8b1f6a1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.304387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65861a4-c85c-4a54-9c09-b1c8b1f6a1d5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.316692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1262/2547] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:49.320959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.330934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4f2d-5f3b-4cb4-b774-b9b77ae37501 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.335691 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.336485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.336999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.337335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] PATH_INFO: `/v3/projects/0314482c6feb40b1bc02344ba3edc25e/users/e9859beedb324f539ecfed3771c85812/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.353767 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0314482c6feb40b1bc02344ba3edc25e, user_id=e9859beedb324f539ecfed3771c85812, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.356534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.372584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1286/2548] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:49 2022] PUT /identity/v3/projects/0314482c6feb40b1bc02344ba3edc25e/users/e9859beedb324f539ecfed3771c85812/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:21:49.384372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.384826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.386731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.419924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] MFA Rules not processed for user `e9859beedb324f539ecfed3771c85812`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:49.421642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:49.486687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1263/2549] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:49.491281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.531514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:49.555478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d76a-c8d5-437a-bdc1-9920b4a6f7f6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.560131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.560756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.561037 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.561344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.562518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.564465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.594713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1287/2550] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:49.595877 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.607583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f120a42-d3f9-4ac3-b8ae-15c76b179d5d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.626996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:49.667835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.668443 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.668718 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.668985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.669641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.672302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.695261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1264/2551] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:49.699379 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.710077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc781f-8c23-4d15-9609-b41fb14b0f22 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.715367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.716076 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.716424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.716765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.717527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.719235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.730108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1288/2552] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:49.734916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.745233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cf86-2732-4fda-8f08-6cfef3792b81 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.750485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.751137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.751439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.751708 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] PATH_INFO: `/v3/projects/056081c4d9e4424c8cc92cd7e321d1a9/users/64ab5c2ab00d4c749e0946485e81565a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.768729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056081c4d9e4424c8cc92cd7e321d1a9, user_id=64ab5c2ab00d4c749e0946485e81565a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.771392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.784880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1265/2553] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:49 2022] PUT /identity/v3/projects/056081c4d9e4424c8cc92cd7e321d1a9/users/64ab5c2ab00d4c749e0946485e81565a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:21:49.788940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.799485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124615b-81aa-4a8c-a00b-20466bf8f3eb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.857823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd109dde-cdd9-42e8-affd-97e437e9e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.859067 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd109dde-cdd9-42e8-affd-97e437e9e3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.859373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd109dde-cdd9-42e8-affd-97e437e9e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.859639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd109dde-cdd9-42e8-affd-97e437e9e3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.860323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd109dde-cdd9-42e8-affd-97e437e9e3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.861907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd109dde-cdd9-42e8-affd-97e437e9e3c2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.875365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1289/2554] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:49.876481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:49.886680 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f7fcc-c193-4191-a340-f58a9c842e55 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:49.891540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:49.892269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.892587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.892861 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] PATH_INFO: `/v3/projects/056081c4d9e4424c8cc92cd7e321d1a9/users/64ab5c2ab00d4c749e0946485e81565a/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.895347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056081c4d9e4424c8cc92cd7e321d1a9, user_id=64ab5c2ab00d4c749e0946485e81565a, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:49.898172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:49.910070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1266/2555] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:49 2022] PUT /identity/v3/projects/056081c4d9e4424c8cc92cd7e321d1a9/users/64ab5c2ab00d4c749e0946485e81565a/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:21:49.922270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:49.922701 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:49.923052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:49.952739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] MFA Rules not processed for user `64ab5c2ab00d4c749e0946485e81565a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:49.953528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:50.022958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1290/2556] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:21:50.035075 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:50.036893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:50.095604 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8754f3-cf8a-4b1d-ba84-66c3d4658a54 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:50.101956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861ce4-2f21-4c68-9f67-1ba6087840dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:50.102575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861ce4-2f21-4c68-9f67-1ba6087840dc service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:50.102853 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861ce4-2f21-4c68-9f67-1ba6087840dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:50.103122 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861ce4-2f21-4c68-9f67-1ba6087840dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:50.112650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861ce4-2f21-4c68-9f67-1ba6087840dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:50.114063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861ce4-2f21-4c68-9f67-1ba6087840dc service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:50.123437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1267/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:50.543500 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:50.578832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:50.615617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd653f7c-fc4a-43a7-9bf6-35b7e9b5e2db None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:50.620441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:50.621131 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:50.621410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:50.621680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] PATH_INFO: `/v3/users/e9859beedb324f539ecfed3771c85812` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:50.622832 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9859beedb324f539ecfed3771c85812)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:50.625337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:50.672212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9859beedb324f539ecfed3771c85812'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:50.672860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9859beedb324f539ecfed3771c85812'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:50.673456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9859beedb324f539ecfed3771c85812'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:50.685054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9859beedb324f539ecfed3771c85812'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:50.693054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9859beedb324f539ecfed3771c85812'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:50.705751 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1291/2558] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:50 2022] DELETE /identity/v3/users/e9859beedb324f539ecfed3771c85812 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:50.710216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:50.710501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:50.710790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:50.729807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:50.730985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:50.789337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1268/2559] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:21:50.800358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:50.801783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:50.860207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6b0c0-a224-439c-a694-f7af1f901372 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:50.864023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:50.864634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:50.864909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:50.865182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:50.875250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:50.876663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:50.885922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1292/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:51.160284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:51.162354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:51.182226 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62f28-a5c3-4621-9709-8fc23673cdca None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:51.187931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:51.189087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:51.189087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:51.189333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] PATH_INFO: `/v3/projects/0314482c6feb40b1bc02344ba3edc25e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:51.190403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0314482c6feb40b1bc02344ba3edc25e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:51.192661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:51.205037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:51.245525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0314482c6feb40b1bc02344ba3edc25e', 'request_id': 'req-30891459-fd06-4054-ad22-6bce7dbd8819'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.251138 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0314482c6feb40b1bc02344ba3edc25e', 'request_id': 'req-30891459-fd06-4054-ad22-6bce7dbd8819'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.257505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0314482c6feb40b1bc02344ba3edc25e', 'request_id': 'req-30891459-fd06-4054-ad22-6bce7dbd8819'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.270407 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] The token cache is being invalidate because project 0314482c6feb40b1bc02344ba3edc25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:21:51.270690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.271367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.272848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1269/2561] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:21:51 2022] DELETE /identity/v3/projects/0314482c6feb40b1bc02344ba3edc25e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:51.277009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:51.287255 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb348de-1f32-41cd-90f1-c8f73277de7a service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:51.339102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:51.347624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:51.348518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:51.348962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:51.349239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] PATH_INFO: `/v3/users/64ab5c2ab00d4c749e0946485e81565a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:51.350399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ab5c2ab00d4c749e0946485e81565a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:51.352366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:51.522846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ab5c2ab00d4c749e0946485e81565a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.523585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ab5c2ab00d4c749e0946485e81565a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.524232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ab5c2ab00d4c749e0946485e81565a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.536433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ab5c2ab00d4c749e0946485e81565a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.542927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7303f0a1-ef44-4589-94c3-6e0dee713509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ab5c2ab00d4c749e0946485e81565a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:51.554721 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1293/2562] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:51 2022] DELETE /identity/v3/users/64ab5c2ab00d4c749e0946485e81565a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:51.879706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:51.881208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:51.903856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30891459-fd06-4054-ad22-6bce7dbd8819 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:51.965154 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:51.965793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:51.966096 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:51.966374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] PATH_INFO: `/v3/projects/056081c4d9e4424c8cc92cd7e321d1a9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:51.968570 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=056081c4d9e4424c8cc92cd7e321d1a9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:51.970335 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.016608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056081c4d9e4424c8cc92cd7e321d1a9', 'request_id': 'req-5fb52b74-e56c-49eb-9aee-ffedc016e848'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:52.022546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056081c4d9e4424c8cc92cd7e321d1a9', 'request_id': 'req-5fb52b74-e56c-49eb-9aee-ffedc016e848'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:52.029315 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056081c4d9e4424c8cc92cd7e321d1a9', 'request_id': 'req-5fb52b74-e56c-49eb-9aee-ffedc016e848'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:52.042964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] The token cache is being invalidate because project 056081c4d9e4424c8cc92cd7e321d1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:21:52.043192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:52.043810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5fb52b74-e56c-49eb-9aee-ffedc016e848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:52.045281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1270/2563] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:21:51 2022] DELETE /identity/v3/projects/056081c4d9e4424c8cc92cd7e321d1a9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:52.052063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.052353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.052677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.072443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:52.073635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:52.132527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1294/2564] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:52.141121 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.141406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.141681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.161103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:52.162322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:52.171021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1271/2565] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:52.175454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.185088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2019b-1fe9-48f3-83cc-ce4f2d477670 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.190328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.191230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.191513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.191783 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.192469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:21:52.192764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.194353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.210250 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1295/2566] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:21:52.211587 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.221213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2fd94-88ca-4cf9-ae40-56c4d9cd0e4c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.225937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.226614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.226860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.227129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.227842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.229756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.252105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:52.262879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1272/2567] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:52.264094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.274478 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebf488-b58d-4c53-a10b-305bb0314903 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.333022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.333551 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.333828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.334095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.334741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.336688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.345592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:52.357392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1296/2568] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:21:52.361560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.371883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b694-1202-427d-ae82-c4268174528c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.376950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.377549 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.377825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.378091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.378786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.380372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.390975 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1273/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:52.394769 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.404383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfeef3-65d2-4d9e-996c-8ad6845f42ad admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.408874 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4bcbf-f029-470d-a603-707300b6172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.409456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4bcbf-f029-470d-a603-707300b6172b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.409732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4bcbf-f029-470d-a603-707300b6172b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.410001 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4bcbf-f029-470d-a603-707300b6172b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.410675 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4bcbf-f029-470d-a603-707300b6172b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.412292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4bcbf-f029-470d-a603-707300b6172b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.422315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1297/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:52.426171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.436325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6470-2c15-48ae-ac9a-b10260cd462a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.441137 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.441787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.442065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.442337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] PATH_INFO: `/v3/projects/e90e22429e1b4b1d882921a250dae4ec/users/8a1e9d7d9db44944bd872bea3bbda310/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.458489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90e22429e1b4b1d882921a250dae4ec, user_id=8a1e9d7d9db44944bd872bea3bbda310, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.461153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.475949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1274/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:52 2022] PUT /identity/v3/projects/e90e22429e1b4b1d882921a250dae4ec/users/8a1e9d7d9db44944bd872bea3bbda310/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:52.487107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.487415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.487686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.514849 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] MFA Rules not processed for user `8a1e9d7d9db44944bd872bea3bbda310`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:52.516083 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:52.578544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1298/2572] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:52.582894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.769818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6449b-d839-4fa9-b29b-7568ef852ee9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.774486 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.775091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.775400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.775671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.776328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.778201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.804384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1275/2573] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:52.808659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.820091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a0673-691c-4b1f-abe0-f3aaafc53823 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.876575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.877189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.877469 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.877739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.878399 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.880377 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.902766 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1299/2574] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:21:52 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:21:52.908453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.921958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73eed9-0abf-4c5f-8687-d2868fe93f6e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.929003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.929003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.929003 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.929503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.929886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.931596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:52.951098 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1276/2575] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:52.955393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:52.966155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78849d-918b-40bc-a7c3-d36ad605d988 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:52.971101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:52.972737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:52.973019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:52.973293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] PATH_INFO: `/v3/projects/d33598db13f54fe0a00ff17254142986/users/f1fd14599e504419a2a6d765a9dd1e66/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:52.994851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33598db13f54fe0a00ff17254142986, user_id=f1fd14599e504419a2a6d765a9dd1e66, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:52.994851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:53.006977 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1300/2576] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:52 2022] PUT /identity/v3/projects/d33598db13f54fe0a00ff17254142986/users/f1fd14599e504419a2a6d765a9dd1e66/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:53.010958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:53.021947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b2bc5-44cc-4b32-b6e9-3dc88ebeea52 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:53.079774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3c7b-0532-4328-996c-42db0dbd909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:53.080508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3c7b-0532-4328-996c-42db0dbd909c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:53.080858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3c7b-0532-4328-996c-42db0dbd909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:53.081203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3c7b-0532-4328-996c-42db0dbd909c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:53.081894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3c7b-0532-4328-996c-42db0dbd909c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:53.083509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3c7b-0532-4328-996c-42db0dbd909c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:53.094022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1277/2577] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:21:53.098215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:53.109442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831274fc-9386-4d2d-9e8f-9e249ffdebd6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:53.114176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:53.114915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:53.115298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:53.115641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] PATH_INFO: `/v3/projects/d33598db13f54fe0a00ff17254142986/users/f1fd14599e504419a2a6d765a9dd1e66/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:53.117640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33598db13f54fe0a00ff17254142986, user_id=f1fd14599e504419a2a6d765a9dd1e66, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:53.120407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:53.141262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1301/2578] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:21:53 2022] PUT /identity/v3/projects/d33598db13f54fe0a00ff17254142986/users/f1fd14599e504419a2a6d765a9dd1e66/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:53.144554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ff6a-5b35-4ce1-99eb-c1a9351bf618 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:53.144836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ff6a-5b35-4ce1-99eb-c1a9351bf618 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:53.145108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ff6a-5b35-4ce1-99eb-c1a9351bf618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:53.175128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c4e6ff6a-5b35-4ce1-99eb-c1a9351bf618 None None] MFA Rules not processed for user `f1fd14599e504419a2a6d765a9dd1e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:53.176369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c4e6ff6a-5b35-4ce1-99eb-c1a9351bf618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:53.203074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:53.255148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1278/2579] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:53.270306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:53.273820 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:53.306687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:53.350219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3e2e7-bc8f-4407-9dea-10c45e616c2e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:53.354064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5db1-0f77-4784-9aa0-b647040d1145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:53.354777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5db1-0f77-4784-9aa0-b647040d1145 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:53.355130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5db1-0f77-4784-9aa0-b647040d1145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:53.355505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5db1-0f77-4784-9aa0-b647040d1145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:53.450922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5db1-0f77-4784-9aa0-b647040d1145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:53.452674 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5db1-0f77-4784-9aa0-b647040d1145 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:53.462246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1302/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:53.988439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2065b5-110c-447c-bc6d-836554aa361f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:53.988724 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2065b5-110c-447c-bc6d-836554aa361f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:53.989052 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2065b5-110c-447c-bc6d-836554aa361f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:53.990455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1279/2581] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:21:53.996937 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e4d9-6546-41c7-9aee-b8c635b42cb9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:53.997440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e4d9-6546-41c7-9aee-b8c635b42cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:53.997541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e4d9-6546-41c7-9aee-b8c635b42cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.018173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-03b9e4d9-6546-41c7-9aee-b8c635b42cb9 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:54.019432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-03b9e4d9-6546-41c7-9aee-b8c635b42cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:54.091708 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1303/2582] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:21:54.104073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2065b5-110c-447c-bc6d-836554aa361f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:54.105817 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fb2065b5-110c-447c-bc6d-836554aa361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:54.165422 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2065b5-110c-447c-bc6d-836554aa361f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:54.169615 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e2dbb-4836-44a9-a4ef-2bb234a9fe02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:54.170230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e2dbb-4836-44a9-a4ef-2bb234a9fe02 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.171086 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e2dbb-4836-44a9-a4ef-2bb234a9fe02 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.171361 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e2dbb-4836-44a9-a4ef-2bb234a9fe02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.183927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e2dbb-4836-44a9-a4ef-2bb234a9fe02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:54.185372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e2dbb-4836-44a9-a4ef-2bb234a9fe02 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:54.197379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1280/2583] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:54.266365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae14eb-44ab-4c27-a7c5-dabea789f34c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.266662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae14eb-44ab-4c27-a7c5-dabea789f34c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.266922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae14eb-44ab-4c27-a7c5-dabea789f34c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.268296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1304/2584] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:21:54.273094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06af20-3eb3-4e70-a04f-5c2c890de020 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.273393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06af20-3eb3-4e70-a04f-5c2c890de020 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.273641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06af20-3eb3-4e70-a04f-5c2c890de020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.293372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2c06af20-3eb3-4e70-a04f-5c2c890de020 None None] MFA Rules not processed for user `b5b9b3ac8ed94fc1831476c8d41323b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:54.294573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2c06af20-3eb3-4e70-a04f-5c2c890de020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:54.347947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1281/2585] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:21:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:21:54.359869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae14eb-44ab-4c27-a7c5-dabea789f34c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:54.361533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b1ae14eb-44ab-4c27-a7c5-dabea789f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:54.374893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae14eb-44ab-4c27-a7c5-dabea789f34c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:54.378344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da0c93-9576-4ff0-bfd4-d89ee27e0069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:54.378930 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0c93-9576-4ff0-bfd4-d89ee27e0069 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.379234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0c93-9576-4ff0-bfd4-d89ee27e0069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.379504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0c93-9576-4ff0-bfd4-d89ee27e0069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.386218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0c93-9576-4ff0-bfd4-d89ee27e0069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:54.387682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0c93-9576-4ff0-bfd4-d89ee27e0069 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:54.395239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1305/2586] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:54.480575 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7568-ddf9-46d5-bb46-39c7c91f2919 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.480858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7568-ddf9-46d5-bb46-39c7c91f2919 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.481129 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7568-ddf9-46d5-bb46-39c7c91f2919 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.482496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1282/2587] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 05:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 05:21:54.488108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.488388 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.488657 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.508233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] MFA Rules not processed for user `097e3f30073e48ec832b53d8f89d0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:54.509411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:54.519078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1306/2588] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 05:21:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:54.529609 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7568-ddf9-46d5-bb46-39c7c91f2919 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:54.541717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7568-ddf9-46d5-bb46-39c7c91f2919 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:54.545218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f6a00-dbc1-436a-a33c-f2931372f384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:54.545868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f6a00-dbc1-436a-a33c-f2931372f384 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.546146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f6a00-dbc1-436a-a33c-f2931372f384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.546410 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f6a00-dbc1-436a-a33c-f2931372f384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.556538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f6a00-dbc1-436a-a33c-f2931372f384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:54.557945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f6a00-dbc1-436a-a33c-f2931372f384 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:54.569322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1283/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:54.835993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:54.837475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:54.848934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020f5da-93f5-463e-b663-0e76382e3fb8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:54.852614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:54.853240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:54.853590 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:54.853928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:54.864444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:54.865868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:54.876215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1307/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:56.414929 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:56.415412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:56.415563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:56.440790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:56.442000 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:56.497039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1284/2591] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 05:21:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:56.510908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:56.512346 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:56.552386 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:56.581621 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e916-6cd9-4f5c-bbbb-adf5d0643e28 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:56.586328 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c8afa-9b88-4140-b6d0-874ef3f574de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:56.586927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8afa-9b88-4140-b6d0-874ef3f574de service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:56.587236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8afa-9b88-4140-b6d0-874ef3f574de service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:56.587526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8afa-9b88-4140-b6d0-874ef3f574de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:56.595805 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c8afa-9b88-4140-b6d0-874ef3f574de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:56.597462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c8afa-9b88-4140-b6d0-874ef3f574de service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:56.605449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1308/2592] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:21:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:21:58.715997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:58.722254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:58.816923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d3af-c3c8-472b-a963-c76e7339dfc8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:58.829783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:58.830733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:58.831179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:58.831627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] PATH_INFO: `/v3/users/8a1e9d7d9db44944bd872bea3bbda310` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:58.832998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1e9d7d9db44944bd872bea3bbda310)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:58.834928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:58.897744 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1e9d7d9db44944bd872bea3bbda310'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:58.898618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1e9d7d9db44944bd872bea3bbda310'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:58.899618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1e9d7d9db44944bd872bea3bbda310'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:58.909733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1e9d7d9db44944bd872bea3bbda310'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:58.938750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1e9d7d9db44944bd872bea3bbda310'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:58.958099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1285/2593] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:58 2022] DELETE /identity/v3/users/8a1e9d7d9db44944bd872bea3bbda310 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:21:58.962723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:58.963246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:58.963461 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:58.983813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:21:58.985090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:59.050182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1309/2594] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:21:59.060294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:59.062342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:59.131044 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb03d6-d9cb-40da-844a-a5fadc5ba94c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:59.137801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:59.137801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:59.137801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:59.137801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:59.147042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:59.148520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:59.158819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1286/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:21:59.458488 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:59.460467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:21:59.484141 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09cb18-0a46-4556-9eeb-5bc5ed9e8fe9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:59.488823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:59.489499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:59.489781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:59.490053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] PATH_INFO: `/v3/projects/e90e22429e1b4b1d882921a250dae4ec` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:59.491584 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90e22429e1b4b1d882921a250dae4ec)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:59.493497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:59.557717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90e22429e1b4b1d882921a250dae4ec', 'request_id': 'req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.564564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90e22429e1b4b1d882921a250dae4ec', 'request_id': 'req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.571473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90e22429e1b4b1d882921a250dae4ec', 'request_id': 'req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.585680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] The token cache is being invalidate because project e90e22429e1b4b1d882921a250dae4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:21:59.585971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.586587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.591081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1310/2596] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:21:59 2022] DELETE /identity/v3/projects/e90e22429e1b4b1d882921a250dae4ec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:21:59.592303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:21:59.602440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51258-cb83-4c48-bbb1-9fb6fca13d34 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:21:59.631090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:59.676947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:21:59.677668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:21:59.677941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:21:59.678322 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] PATH_INFO: `/v3/users/f1fd14599e504419a2a6d765a9dd1e66` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:21:59.679566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fd14599e504419a2a6d765a9dd1e66)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:21:59.681466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:21:59.739956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fd14599e504419a2a6d765a9dd1e66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.740626 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fd14599e504419a2a6d765a9dd1e66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.741185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fd14599e504419a2a6d765a9dd1e66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.748607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fd14599e504419a2a6d765a9dd1e66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.756270 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9b8dd948-095d-4b9c-b240-87b1d85ca51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fd14599e504419a2a6d765a9dd1e66'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:21:59.776474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1287/2597] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:21:59 2022] DELETE /identity/v3/users/f1fd14599e504419a2a6d765a9dd1e66 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:22:00.192337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.194021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:00.216306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba6dc-5f66-4b8f-8457-5589583a1de1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.267112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:00.284432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.285074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.285352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.285623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] PATH_INFO: `/v3/projects/d33598db13f54fe0a00ff17254142986` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.286777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33598db13f54fe0a00ff17254142986)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.288709 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.340579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33598db13f54fe0a00ff17254142986', 'request_id': 'req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:00.346033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33598db13f54fe0a00ff17254142986', 'request_id': 'req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:00.352391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33598db13f54fe0a00ff17254142986', 'request_id': 'req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:00.366914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] The token cache is being invalidate because project d33598db13f54fe0a00ff17254142986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:22:00.367246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:00.367946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-701c5d6f-22d8-4516-b4e7-0d9e51efcbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:00.369511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1311/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:22:00 2022] DELETE /identity/v3/projects/d33598db13f54fe0a00ff17254142986 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:00.374970 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.375285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.375563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.396507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:00.397941 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:00.459818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1288/2599] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:22:00.468583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.468869 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.469147 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.489634 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:00.490850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:00.499817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1312/2600] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:00.504343 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.516127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84547a0-5352-443e-89e0-9adc36d4fb30 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.521069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.521756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.522102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.522438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.523222 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:22:00.523588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.525378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.542635 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1289/2601] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:22:00.547457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.556934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544df0c-0c32-47ea-8272-1d663cc3601a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.561663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.562282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.562587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.562823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.563509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.565671 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.597211 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1313/2602] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:22:00 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:22:00.601415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.612737 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6003d-c59a-4161-bfe6-de7898cf9ef1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.645402 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:00.677969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.678559 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.678879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.679116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.679841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.681834 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.706233 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1290/2603] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:22:00 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:22:00.710529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.721867 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ff556-33c1-45bb-ac6a-c45a5536d8af admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.726664 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.727370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.727639 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.727868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.728615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.730231 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.741028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1314/2604] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:00.745142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.756551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775e83-3685-4fc4-b1d8-17c58903ebe3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.761425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a63c7-143f-4c51-bb97-f14b59c20cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.762168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a63c7-143f-4c51-bb97-f14b59c20cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.762546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a63c7-143f-4c51-bb97-f14b59c20cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.762879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a63c7-143f-4c51-bb97-f14b59c20cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.763726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a63c7-143f-4c51-bb97-f14b59c20cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.766857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a63c7-143f-4c51-bb97-f14b59c20cfd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.781355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1291/2605] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:00.782531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:00.792756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe563-7ac7-4217-9758-77b8729476e5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:00.797572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:00.798306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.798670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.799143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] PATH_INFO: `/v3/projects/856149d7d5964e8789f086d587b6c933/users/7e09e31c88f2488d839859c1d14e6c6e/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.815646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=856149d7d5964e8789f086d587b6c933, user_id=7e09e31c88f2488d839859c1d14e6c6e, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:00.818327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:00.834413 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1315/2606] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:00 2022] PUT /identity/v3/projects/856149d7d5964e8789f086d587b6c933/users/7e09e31c88f2488d839859c1d14e6c6e/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:00.844560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:00.844892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:00.845161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:00.874120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] MFA Rules not processed for user `7e09e31c88f2488d839859c1d14e6c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:00.875376 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:00.950432 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1292/2607] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:22:00.955839 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.021436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5f63c-4d32-48e3-825e-8c4223936f9a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.026127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.026776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.027057 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.027370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.028065 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.030192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.052978 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:01.063986 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1316/2608] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:22:00 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:22:01.067992 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.079612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280019f-fb55-4aa3-8999-66ec7c70b9eb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.141469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.142089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.142371 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.142643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.143338 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.145247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.169140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1293/2609] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:22:01 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:22:01.173455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.184323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab0624-7071-408d-9113-5256691c46ab admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.191063 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.191991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.192333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.192678 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.193453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.195275 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.206981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1317/2610] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:01.211041 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.223715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1b28b-ef6c-4ad5-a9c8-90858e8668e4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.230614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.232061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.232318 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.233279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] PATH_INFO: `/v3/projects/0f4352c804b94ad3bd6e24dba597bf9f/users/9f083489fbac4bfa8b24ade3c3b0e4ae/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.253465 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4352c804b94ad3bd6e24dba597bf9f, user_id=9f083489fbac4bfa8b24ade3c3b0e4ae, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.256770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.278826 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1294/2611] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:01 2022] PUT /identity/v3/projects/0f4352c804b94ad3bd6e24dba597bf9f/users/9f083489fbac4bfa8b24ade3c3b0e4ae/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:01.280050 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.290302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80412-1b08-4194-843b-bec63d692f73 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.353747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537503-12de-49ef-b03e-7d4f3e2d79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.354518 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537503-12de-49ef-b03e-7d4f3e2d79d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.354852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537503-12de-49ef-b03e-7d4f3e2d79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.355239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537503-12de-49ef-b03e-7d4f3e2d79d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.355993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537503-12de-49ef-b03e-7d4f3e2d79d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.358217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537503-12de-49ef-b03e-7d4f3e2d79d4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.374441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.376133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1318/2612] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:01.385647 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f4834-2d0c-4822-be3f-d3bf286e2b9a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.391420 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.392094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.392450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.392818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] PATH_INFO: `/v3/projects/0f4352c804b94ad3bd6e24dba597bf9f/users/9f083489fbac4bfa8b24ade3c3b0e4ae/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.395131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4352c804b94ad3bd6e24dba597bf9f, user_id=9f083489fbac4bfa8b24ade3c3b0e4ae, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.397932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.400643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:01.411676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1295/2613] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:01 2022] PUT /identity/v3/projects/0f4352c804b94ad3bd6e24dba597bf9f/users/9f083489fbac4bfa8b24ade3c3b0e4ae/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:01.425188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.425451 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.425724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.457304 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] MFA Rules not processed for user `9f083489fbac4bfa8b24ade3c3b0e4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:01.458528 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:01.528958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1319/2614] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:22:01.541007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.542715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:01.608326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816f7a-c67d-44b6-b648-1b07d0b96110 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.612180 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3409d47-e235-4256-99d7-3163ca250fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.612800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409d47-e235-4256-99d7-3163ca250fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.613083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409d47-e235-4256-99d7-3163ca250fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.613356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409d47-e235-4256-99d7-3163ca250fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.623325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3409d47-e235-4256-99d7-3163ca250fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.624783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3409d47-e235-4256-99d7-3163ca250fe8 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.637247 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1296/2615] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:01.704365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.775348 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79fbd-ae05-486f-900a-0816a94a6e18 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:01.780806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:01.781382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.781658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.781925 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] PATH_INFO: `/v3/users/7e09e31c88f2488d839859c1d14e6c6e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.783090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e09e31c88f2488d839859c1d14e6c6e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:01.785026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:01.800442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:01.834421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e09e31c88f2488d839859c1d14e6c6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:01.835176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e09e31c88f2488d839859c1d14e6c6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:01.835772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e09e31c88f2488d839859c1d14e6c6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:01.852151 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e09e31c88f2488d839859c1d14e6c6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:01.860670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e09e31c88f2488d839859c1d14e6c6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:01.873714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1320/2616] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:22:01 2022] DELETE /identity/v3/users/7e09e31c88f2488d839859c1d14e6c6e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:01.878649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:01.879139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:01.879389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:01.899454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:01.901016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:01.966041 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1297/2617] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:01.976817 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:01.978280 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:02.044534 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c90c79-ac14-495b-affe-9c63a0d60296 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:02.049322 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:02.049942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:02.050583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:02.050858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:02.060967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:02.063138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:02.073735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1321/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:02.374396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:02.376278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:02.395126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd643b-3822-4101-b77c-c88a40c6b56f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:02.409200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:02.409937 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:02.410254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:02.410539 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] PATH_INFO: `/v3/projects/856149d7d5964e8789f086d587b6c933` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:02.411785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856149d7d5964e8789f086d587b6c933)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:02.413809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:02.487243 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856149d7d5964e8789f086d587b6c933', 'request_id': 'req-9f2e6713-8e85-4c11-8b75-d5e36e821969'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.493836 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856149d7d5964e8789f086d587b6c933', 'request_id': 'req-9f2e6713-8e85-4c11-8b75-d5e36e821969'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.514212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856149d7d5964e8789f086d587b6c933', 'request_id': 'req-9f2e6713-8e85-4c11-8b75-d5e36e821969'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.533259 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] The token cache is being invalidate because project 856149d7d5964e8789f086d587b6c933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:22:02.533538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.534286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.536756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1298/2619] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:22:02 2022] DELETE /identity/v3/projects/856149d7d5964e8789f086d587b6c933 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:02.546114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:02.558659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:02.559823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b1ab3-925b-4a09-8f31-b346f914ec00 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:02.560397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:02.588566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:02.627770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:02.628416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:02.628696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:02.628962 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] PATH_INFO: `/v3/users/9f083489fbac4bfa8b24ade3c3b0e4ae` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:02.630130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f083489fbac4bfa8b24ade3c3b0e4ae)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:02.632186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:02.640785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e6713-8e85-4c11-8b75-d5e36e821969 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:02.646950 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:02.647742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:02.648076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:02.648356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:02.650513 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:02.677483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:02.701784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f083489fbac4bfa8b24ade3c3b0e4ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.703752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f083489fbac4bfa8b24ade3c3b0e4ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.704652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f083489fbac4bfa8b24ade3c3b0e4ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.723198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f083489fbac4bfa8b24ade3c3b0e4ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.730439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f083489fbac4bfa8b24ade3c3b0e4ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:02.738321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:02.740090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7ce35-7573-4f25-93b5-0e1418b81d1a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:02.745542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1322/2620] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:22:02 2022] DELETE /identity/v3/users/9f083489fbac4bfa8b24ade3c3b0e4ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:02.758216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1299/2621] 10.222.0.27 () {60 vars in 1396 bytes} [Fri Aug 5 05:22:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:03.080041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.081620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:03.164359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0589-6f9c-4871-a812-669c5d62e826 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.169215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.169927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.170239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.170515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] PATH_INFO: `/v3/projects/0f4352c804b94ad3bd6e24dba597bf9f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.171729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4352c804b94ad3bd6e24dba597bf9f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.173695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.227380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4352c804b94ad3bd6e24dba597bf9f', 'request_id': 'req-b2568963-67b9-44b6-8871-c834b5495b43'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:03.234285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4352c804b94ad3bd6e24dba597bf9f', 'request_id': 'req-b2568963-67b9-44b6-8871-c834b5495b43'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:03.240912 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4352c804b94ad3bd6e24dba597bf9f', 'request_id': 'req-b2568963-67b9-44b6-8871-c834b5495b43'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:03.255581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] The token cache is being invalidate because project 0f4352c804b94ad3bd6e24dba597bf9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:22:03.255875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:03.256516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2568963-67b9-44b6-8871-c834b5495b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:03.258061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1323/2622] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:22:03 2022] DELETE /identity/v3/projects/0f4352c804b94ad3bd6e24dba597bf9f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:03.263176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.263664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.264525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.284324 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:03.285552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:03.349544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1300/2623] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:03.357481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.358735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.359278 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.382264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:03.383673 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:03.396327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1324/2624] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:03.397504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.409090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6c58-f463-481c-83c0-3fe189798338 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.413845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.414531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.414831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.415103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.415842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:22:03.416146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.417760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.431148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1301/2625] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:22:03.435717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.445442 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d4274-305b-488c-aba9-cc33c1719046 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.450201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.450943 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.452047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.452331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.453267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.455538 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.485858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1325/2626] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:22:03 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:22:03.487012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.497282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c92ce-164d-4988-98ad-0868cd3ffa1b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.565969 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.566584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.566862 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.567132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.567825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.569722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.580256 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:03.602034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1302/2627] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:22:03 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:22:03.606062 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.617158 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e25af-42fd-432a-b620-b14fc3999469 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.621941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.622561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.622841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.623181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.624494 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.626110 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.637357 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1326/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:03.641961 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.652345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7368ab-9b25-4250-a56b-1505542f0459 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.659181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb335-ecdb-463b-af69-0e0e852d37a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.661136 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb335-ecdb-463b-af69-0e0e852d37a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.661423 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb335-ecdb-463b-af69-0e0e852d37a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.661701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb335-ecdb-463b-af69-0e0e852d37a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.662405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb335-ecdb-463b-af69-0e0e852d37a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.664076 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb335-ecdb-463b-af69-0e0e852d37a8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.676253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1303/2629] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:03.680464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.686043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:03.693193 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5537-56d9-4ea2-acce-b5db4141e1e9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.704452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.705072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.705347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.705614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] PATH_INFO: `/v3/projects/4a370b25fdc24fcb9890f514c96702c0/users/5d88d5546c2f49f4b4b1b39b426f6aca/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.723121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a370b25fdc24fcb9890f514c96702c0, user_id=5d88d5546c2f49f4b4b1b39b426f6aca, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.725886 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.741980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1327/2630] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:03 2022] PUT /identity/v3/projects/4a370b25fdc24fcb9890f514c96702c0/users/5d88d5546c2f49f4b4b1b39b426f6aca/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:22:03.754206 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.754488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.754757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.785030 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] MFA Rules not processed for user `5d88d5546c2f49f4b4b1b39b426f6aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:03.786356 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:03.867205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1304/2631] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:03.881826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:03.884161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:03.954530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630586a7-10a6-43c2-ac31-8e779e5c257d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:03.958341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272d7f5-4b2e-43e4-bc01-5a0c7528311f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:03.959028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272d7f5-4b2e-43e4-bc01-5a0c7528311f service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:03.959397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272d7f5-4b2e-43e4-bc01-5a0c7528311f service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:03.959733 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272d7f5-4b2e-43e4-bc01-5a0c7528311f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:03.969245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272d7f5-4b2e-43e4-bc01-5a0c7528311f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:03.970771 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272d7f5-4b2e-43e4-bc01-5a0c7528311f service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:03.980660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1328/2632] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:06.605287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:06.672651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ee7b7-49b6-4a73-8754-f90ed55a16d2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:06.677520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:06.678160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:06.678503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:06.678858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] PATH_INFO: `/v3/users/5d88d5546c2f49f4b4b1b39b426f6aca` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:06.683843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d88d5546c2f49f4b4b1b39b426f6aca)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:06.683843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:06.732037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d88d5546c2f49f4b4b1b39b426f6aca'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:06.733328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d88d5546c2f49f4b4b1b39b426f6aca'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:06.733900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d88d5546c2f49f4b4b1b39b426f6aca'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:06.740882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d88d5546c2f49f4b4b1b39b426f6aca'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:06.747868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d88d5546c2f49f4b4b1b39b426f6aca'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:06.754830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:06.766740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1305/2633] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:22:06 2022] DELETE /identity/v3/users/5d88d5546c2f49f4b4b1b39b426f6aca => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:06.771460 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:06.771907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:06.772133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:06.792611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:06.793958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:06.855909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1329/2634] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:06.865628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:06.867009 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:06.924900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8962b2-ad26-4741-b7f4-62de9839fd6f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:06.928581 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c00d76-56e8-407d-9ed7-534e146d194e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:06.929120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c00d76-56e8-407d-9ed7-534e146d194e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:06.929401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c00d76-56e8-407d-9ed7-534e146d194e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:06.929670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c00d76-56e8-407d-9ed7-534e146d194e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:06.939144 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c00d76-56e8-407d-9ed7-534e146d194e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:06.940845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c00d76-56e8-407d-9ed7-534e146d194e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:06.950108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1306/2635] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 05:22:07.220945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.222511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:07.235679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cf8dd-d1ab-4af4-9791-576ade5b5dd5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.240655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.241300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.241585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.241859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] PATH_INFO: `/v3/projects/4a370b25fdc24fcb9890f514c96702c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.243020 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a370b25fdc24fcb9890f514c96702c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.244971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.293439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a370b25fdc24fcb9890f514c96702c0', 'request_id': 'req-d9b62a61-02b3-4f3c-9177-be41b78830c8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:07.299853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a370b25fdc24fcb9890f514c96702c0', 'request_id': 'req-d9b62a61-02b3-4f3c-9177-be41b78830c8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:07.306121 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a370b25fdc24fcb9890f514c96702c0', 'request_id': 'req-d9b62a61-02b3-4f3c-9177-be41b78830c8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:07.320046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] The token cache is being invalidate because project 4a370b25fdc24fcb9890f514c96702c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:22:07.320330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:07.320942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9b62a61-02b3-4f3c-9177-be41b78830c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:22:07.322446 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1330/2636] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:22:07 2022] DELETE /identity/v3/projects/4a370b25fdc24fcb9890f514c96702c0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:07.327784 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.328065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.328332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.347580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:07.348783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:07.408281 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1307/2637] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:07.416045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.416332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.416608 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.426140 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:07.439797 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:07.441267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:07.449261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1331/2638] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:07.453421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.463944 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a6565-56aa-41c7-bfc0-398d14f8dae0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.470749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.471561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.471986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.472284 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.473143 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:22:07.473448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.475996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.490232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1308/2639] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:22:07.494360 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.506462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3d441-4d6d-42b4-a7c8-c56954ed2cc6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.511991 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.512702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.513043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.513371 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.514172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.516646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.548568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1332/2640] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:22:07 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:22:07.552566 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.562565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83279a1-23c9-4f87-b78a-76749a9cd27a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.619726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.620444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.620603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.620875 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.621563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.623597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.646254 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1309/2641] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:22:07 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:22:07.650398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.661112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4f044-58a2-4375-bae9-1c0de60a38fc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.665727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.666323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.666627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.666898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.667616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.669190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.679482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1333/2642] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:07.683384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.693636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6f0e-ea9a-4bf7-a707-12111cf87771 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.698364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f493f-65b3-4345-b3b3-b107d829c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.698957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f493f-65b3-4345-b3b3-b107d829c31a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.699269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f493f-65b3-4345-b3b3-b107d829c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.699543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f493f-65b3-4345-b3b3-b107d829c31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.700213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f493f-65b3-4345-b3b3-b107d829c31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.702058 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f493f-65b3-4345-b3b3-b107d829c31a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.704214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:07.713775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1310/2643] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:07.718350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.728079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e17ab-7219-45db-90cd-4855e03ddc4f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.733319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.733965 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.734245 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.734521 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] PATH_INFO: `/v3/projects/6e6193f6238342cb968fa7b7a2d72eaa/users/5c6c98a87bfb4fafab9315c18630881f/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.748696 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6193f6238342cb968fa7b7a2d72eaa, user_id=5c6c98a87bfb4fafab9315c18630881f, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.751363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.763864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1334/2644] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:07 2022] PUT /identity/v3/projects/6e6193f6238342cb968fa7b7a2d72eaa/users/5c6c98a87bfb4fafab9315c18630881f/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:07.768859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b97028-00e5-4db5-901d-c46d1e5d1223 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.769153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b97028-00e5-4db5-901d-c46d1e5d1223 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.769431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b97028-00e5-4db5-901d-c46d1e5d1223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.788468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-37b97028-00e5-4db5-901d-c46d1e5d1223 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:07.789666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-37b97028-00e5-4db5-901d-c46d1e5d1223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:07.853396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1311/2645] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:07.864339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:07.866069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:07.924487 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72c342-01ff-42a5-9b41-40ca3d7fa7a5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:07.928132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:07.928750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:07.929027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:07.929292 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:07.938411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:07.939953 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:07.949688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1335/2646] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:11.646749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cf24-d4c4-4ba4-972d-2ce8ac7645fc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:11.647253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cf24-d4c4-4ba4-972d-2ce8ac7645fc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:11.647372 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cf24-d4c4-4ba4-972d-2ce8ac7645fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:11.674859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c0b7cf24-d4c4-4ba4-972d-2ce8ac7645fc None None] MFA Rules not processed for user `a93912065a104431952b02803d7c3c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:11.676463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0b7cf24-d4c4-4ba4-972d-2ce8ac7645fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:11.751400 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1312/2647] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 05:22:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:11.768519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:11.770695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:11.855535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248f73-d38b-4d88-8775-b84599891979 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:11.863264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f965b370df48a3a79ba0dd8a2ddf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:11.863887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:11.864167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:11.864435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:11.874406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:11.877426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:11.889730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1336/2648] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 05:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 05:22:12.522760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:12.523333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:12.523663 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:12.561352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] MFA Rules not processed for user `5c6c98a87bfb4fafab9315c18630881f`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:12.564026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:12.669294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1313/2649] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:12.674756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:12.687843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f500-28e5-43f0-9978-c1e0456cced2 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:12.694443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:12.695343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:12.695845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:12.696356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:12.697257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:12.699436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:12.742794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1337/2650] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:22:12 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:22:12.744150 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:12.757645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a383a87-8420-44c0-9500-c86a6b94eb02 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:12.802107 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:12.834636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:12.835438 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:12.835785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:12.836061 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:12.836732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:12.838777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:12.862991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1314/2651] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:22:12 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:22:12.867640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:12.880391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173b8f-9657-4032-aa4d-daefb2b1840e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:12.887113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:12.887734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:12.888021 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:12.888325 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:12.890133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:12.891938 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:12.902576 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:12.911212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1338/2652] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:12.915199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:12.926516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df30f57-47be-4306-b1a7-e297096c95c5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:12.940688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:12.941578 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:12.941925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:12.942266 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] PATH_INFO: `/v3/projects/59cf2b33f1604cbc85ea4c250070795b/users/adee5388d6fe41e2bf09df26c8c925da/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:12.959474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cf2b33f1604cbc85ea4c250070795b, user_id=adee5388d6fe41e2bf09df26c8c925da, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:12.962113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:12.976679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1315/2653] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:12 2022] PUT /identity/v3/projects/59cf2b33f1604cbc85ea4c250070795b/users/adee5388d6fe41e2bf09df26c8c925da/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:22:12.980782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:12.991212 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cacaf-d65b-4717-a4fa-39190ffec363 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:13.052907 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fe14a-58db-4667-8817-e8eef8d299ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:13.053449 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe14a-58db-4667-8817-e8eef8d299ad admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:13.053731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe14a-58db-4667-8817-e8eef8d299ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:13.054005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe14a-58db-4667-8817-e8eef8d299ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:13.054725 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fe14a-58db-4667-8817-e8eef8d299ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:13.056349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fe14a-58db-4667-8817-e8eef8d299ad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:13.067006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1339/2654] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:22:13.071550 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:13.082440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50709e-439b-4bc1-aee1-40de2c43aebc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:13.088537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:13.089215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:13.089482 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:13.089758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] PATH_INFO: `/v3/projects/59cf2b33f1604cbc85ea4c250070795b/users/adee5388d6fe41e2bf09df26c8c925da/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:13.092543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cf2b33f1604cbc85ea4c250070795b, user_id=adee5388d6fe41e2bf09df26c8c925da, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:13.095325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:13.106148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1316/2655] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:22:13 2022] PUT /identity/v3/projects/59cf2b33f1604cbc85ea4c250070795b/users/adee5388d6fe41e2bf09df26c8c925da/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:22:17.648022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cde2d-dbbd-4bfb-98a0-1cfb37eaa120 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:17.648606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cde2d-dbbd-4bfb-98a0-1cfb37eaa120 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:17.649161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cde2d-dbbd-4bfb-98a0-1cfb37eaa120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:17.686811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c82cde2d-dbbd-4bfb-98a0-1cfb37eaa120 None None] MFA Rules not processed for user `adee5388d6fe41e2bf09df26c8c925da`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:17.688186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c82cde2d-dbbd-4bfb-98a0-1cfb37eaa120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:17.759527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1340/2656] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:17.773277 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:17.775059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:17.854882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da7db-5c81-45bf-8db6-c69dfde37aba admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:17.860576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421d172-8d55-406c-8641-d9008d1bbc84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:17.861200 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d172-8d55-406c-8641-d9008d1bbc84 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:17.861480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d172-8d55-406c-8641-d9008d1bbc84 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:17.861751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d172-8d55-406c-8641-d9008d1bbc84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:17.922965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421d172-8d55-406c-8641-d9008d1bbc84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:17.924617 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421d172-8d55-406c-8641-d9008d1bbc84 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:17.934497 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1317/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:18.891660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:18.892157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:18.892253 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:18.912554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] MFA Rules not processed for user `5c6c98a87bfb4fafab9315c18630881f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:18.913900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:18.921636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1341/2658] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:27.563949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:27.564436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:27.564567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:27.584108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] MFA Rules not processed for user `2fa0149b879941fc8b9223ec0c4c81ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:22:27.585301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:27.603354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:27.642081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1318/2659] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:22:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:22:27.953298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:27.955344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:28.012146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9de5c1-8517-48ab-b030-9310884995d3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:28.017160 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:28.017776 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:28.018052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:28.018319 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:28.020085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:28.030054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:28.031515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:28.039618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1342/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:37.634855 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=15 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:38.035742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:44.836868 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:44.846397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73b683-e201-4f62-9209-4d0e868efad6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:44.849908 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:44.850509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:44.850782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:44.851049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:44.859749 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:44.861789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:44.871017 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1319/2661] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:22:54.866930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:59.123909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:22:59.136008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64934c04-7eb9-41f4-bf55-2b46d27dc3c9 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:22:59.140415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:22:59.141010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:22:59.141286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:22:59.142208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:22:59.144041 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:22:59.206024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:22:59.207483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:22:59.216859 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1343/2662] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:02.306025 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:02.307606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:02.322757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460cde-b815-445b-89ae-a804173f5daf service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:02.327637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:02.328285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:02.328560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:02.328876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] PATH_INFO: `/v3/users/b16a98ac368c405f93dc3c21c9d28834` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:02.330012 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16a98ac368c405f93dc3c21c9d28834)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:02.331933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:02.378358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16a98ac368c405f93dc3c21c9d28834'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.379001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16a98ac368c405f93dc3c21c9d28834'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.379631 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16a98ac368c405f93dc3c21c9d28834'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.386829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16a98ac368c405f93dc3c21c9d28834'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.394387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa305fdc-2489-4080-9e22-f3a8b99b323b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16a98ac368c405f93dc3c21c9d28834'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.411760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1320/2663] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:02 2022] DELETE /identity/v3/users/b16a98ac368c405f93dc3c21c9d28834 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:02.584951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:02.602139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177823-f6f3-4461-9fb2-91736d6ea86f service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:02.662224 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:02.662883 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:02.663249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:02.663474 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] PATH_INFO: `/v3/projects/d16a5f67adde47c7a000607fb23d0530` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:02.664685 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16a5f67adde47c7a000607fb23d0530)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:02.666623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:02.720607 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16a5f67adde47c7a000607fb23d0530', 'request_id': 'req-15a13cf3-a825-4748-bb89-fba773b6526c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.726181 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16a5f67adde47c7a000607fb23d0530', 'request_id': 'req-15a13cf3-a825-4748-bb89-fba773b6526c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.732455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16a5f67adde47c7a000607fb23d0530', 'request_id': 'req-15a13cf3-a825-4748-bb89-fba773b6526c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.746496 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] The token cache is being invalidate because project d16a5f67adde47c7a000607fb23d0530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:02.746784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.747445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-15a13cf3-a825-4748-bb89-fba773b6526c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:02.749006 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1344/2664] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:02 2022] DELETE /identity/v3/projects/d16a5f67adde47c7a000607fb23d0530 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:02.754473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:02.754831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:02.755209 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:02.774857 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:02.776005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:02.842772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1321/2665] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:23:02.852335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:02.852620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:02.852897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:02.872622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:02.873822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:02.881819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1345/2666] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:02.886199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:02.895790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668b228-b117-498e-8a1c-b51b88fc9c95 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:02.900353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:02.900948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:02.901230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:02.901502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:02.902360 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:23:02.902785 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:02.904928 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:02.917078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1322/2667] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:23:02.921440 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:02.931129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2c555-6d85-4964-8892-a63f34a283ce None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:02.935716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:02.936311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:02.936589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:02.936858 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:02.937503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:02.939903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:02.956261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:02.978059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1346/2668] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:02 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:02.982292 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:02.993611 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d986ec-cf44-4241-a1c3-db2dbe4ee3f2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.054833 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.055554 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.055900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.056236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.056945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.058897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.067470 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:03.083881 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1323/2669] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:02 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:03.087967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.099044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6f79-d419-470a-b4ca-112a241c0d3e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.104036 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.104646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.104929 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.105204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.105885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.107633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.118247 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1347/2670] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:03.122177 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.132309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e180-03a4-4cc5-9dfa-2022b0235a01 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.136924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb0e5c-f349-40d0-87cc-99ad30f83dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.137511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb0e5c-f349-40d0-87cc-99ad30f83dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.137789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb0e5c-f349-40d0-87cc-99ad30f83dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.138059 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb0e5c-f349-40d0-87cc-99ad30f83dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.138734 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb0e5c-f349-40d0-87cc-99ad30f83dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.140328 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb0e5c-f349-40d0-87cc-99ad30f83dd0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.150852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1324/2671] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:03.154837 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.165369 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2e2eb-280b-48f8-8214-2540a03c335e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.170069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.170732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.171015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.171329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] PATH_INFO: `/v3/projects/cd8ca08e341c4e249bfdb06115180280/users/31d952432c794b859ab6408ddabfced3/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.187077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8ca08e341c4e249bfdb06115180280, user_id=31d952432c794b859ab6408ddabfced3, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.190053 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.203311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1348/2672] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:03 2022] PUT /identity/v3/projects/cd8ca08e341c4e249bfdb06115180280/users/31d952432c794b859ab6408ddabfced3/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:03.214092 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.214375 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.214645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.242359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] MFA Rules not processed for user `31d952432c794b859ab6408ddabfced3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:03.243599 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:03.305803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1325/2673] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:03.310112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.371122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9984-cd6e-4d61-9833-fb9faffc4161 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.376589 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.377191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.377465 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.377731 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.378387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.380307 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.405485 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1349/2674] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:03 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:23:03.409593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.420237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb546eb-5c93-4744-a2ec-50deb8519e25 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.477459 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.478068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.478346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.478619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.479301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.481199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.502924 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1326/2675] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:03 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:03.506983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.516968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152c696-0dcf-4f5c-944e-499802b979f5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.521489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.522080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.522356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.522623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.523337 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.524905 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.535072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1350/2676] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:03.538951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.549535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a256-0445-4ece-bf6e-e1c858fb8fe9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.553974 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.554608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.554886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.555175 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] PATH_INFO: `/v3/projects/a8dbe34eac2849b59db569f8cd330b00/users/0423c27ca572404281d31e06ec602c0d/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.570183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dbe34eac2849b59db569f8cd330b00, user_id=0423c27ca572404281d31e06ec602c0d, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.572810 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.586510 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1327/2677] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:03 2022] PUT /identity/v3/projects/a8dbe34eac2849b59db569f8cd330b00/users/0423c27ca572404281d31e06ec602c0d/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:03.590473 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.601852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea4e3-ee85-491a-819c-cdb89d16fab4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.658819 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bbe97-272a-4444-af6b-751670fefe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.659476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bbe97-272a-4444-af6b-751670fefe4d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.659756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bbe97-272a-4444-af6b-751670fefe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.660029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bbe97-272a-4444-af6b-751670fefe4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.660724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bbe97-272a-4444-af6b-751670fefe4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.662312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bbe97-272a-4444-af6b-751670fefe4d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.671945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1351/2678] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:23:03.676130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.686528 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff541f-94ef-467a-bdcf-ae200e75b95a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.692056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.692704 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.692988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.693261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] PATH_INFO: `/v3/projects/a8dbe34eac2849b59db569f8cd330b00/users/0423c27ca572404281d31e06ec602c0d/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.695242 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dbe34eac2849b59db569f8cd330b00, user_id=0423c27ca572404281d31e06ec602c0d, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.697872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.708517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1328/2679] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:03 2022] PUT /identity/v3/projects/a8dbe34eac2849b59db569f8cd330b00/users/0423c27ca572404281d31e06ec602c0d/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:03.720107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.720381 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.720649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.747133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] MFA Rules not processed for user `0423c27ca572404281d31e06ec602c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:03.748338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:03.766956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:03.815802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1352/2680] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:03.827049 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.829538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:03.851824 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:03.888532 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307dd4c-0acc-4929-8e15-9e56e39a1b93 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:03.892886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428c7f5-7530-4e2c-9d0e-438f447fcb32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:03.893489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428c7f5-7530-4e2c-9d0e-438f447fcb32 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:03.893771 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428c7f5-7530-4e2c-9d0e-438f447fcb32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:03.894045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428c7f5-7530-4e2c-9d0e-438f447fcb32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:03.903004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428c7f5-7530-4e2c-9d0e-438f447fcb32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:03.904460 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428c7f5-7530-4e2c-9d0e-438f447fcb32 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:03.914071 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1329/2681] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:03.988616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:03.998208 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62af6-4c48-4e83-bebd-6f2992ab6d71 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:04.002189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:04.002791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:04.003072 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:04.003387 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:04.058958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:04.060458 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:04.069951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1353/2682] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:13.909867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=17 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:14.066120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=48 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:26.923811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c25d5-6fa7-40d4-b59d-f70575c041ed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:26.924358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c25d5-6fa7-40d4-b59d-f70575c041ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:26.924358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c25d5-6fa7-40d4-b59d-f70575c041ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:26.943480 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-287c25d5-6fa7-40d4-b59d-f70575c041ed None None] MFA Rules not processed for user `2fa0149b879941fc8b9223ec0c4c81ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:26.944638 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-287c25d5-6fa7-40d4-b59d-f70575c041ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:26.998755 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1330/2683] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:33.307069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:33.373921 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad7c3-0e67-4663-b495-03ef336fbfbd service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:33.378597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:33.379281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:33.379558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:33.379827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] PATH_INFO: `/v3/users/31d952432c794b859ab6408ddabfced3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:33.380994 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d952432c794b859ab6408ddabfced3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:33.382903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:33.431779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d952432c794b859ab6408ddabfced3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:33.432672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d952432c794b859ab6408ddabfced3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:33.433408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d952432c794b859ab6408ddabfced3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:33.446229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d952432c794b859ab6408ddabfced3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:33.453898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d952432c794b859ab6408ddabfced3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:33.471633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1354/2684] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:33 2022] DELETE /identity/v3/users/31d952432c794b859ab6408ddabfced3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:33.477454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:33.477922 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:33.478029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:33.496927 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:33.498111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:33.564596 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1331/2685] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:23:33.574343 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:33.575777 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:33.631862 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f4d2-ddfe-48fa-a249-b27ffc4063c7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:33.635514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:33.636119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:33.636398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:33.636666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:33.646130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:33.647614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:33.657055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1355/2686] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:33.956568 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:33.958403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:33.979362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0cd52-d795-48fb-afe7-a50e07131d75 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:33.984716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:33.985867 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:33.986153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:33.986429 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] PATH_INFO: `/v3/projects/cd8ca08e341c4e249bfdb06115180280` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:33.987629 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8ca08e341c4e249bfdb06115180280)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:33.989526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:34.039149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8ca08e341c4e249bfdb06115180280', 'request_id': 'req-d22d82c2-a934-4705-939b-62d006557b24'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.044651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8ca08e341c4e249bfdb06115180280', 'request_id': 'req-d22d82c2-a934-4705-939b-62d006557b24'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.051838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8ca08e341c4e249bfdb06115180280', 'request_id': 'req-d22d82c2-a934-4705-939b-62d006557b24'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.064257 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] The token cache is being invalidate because project cd8ca08e341c4e249bfdb06115180280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:34.064664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.065271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.066760 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1332/2687] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:33 2022] DELETE /identity/v3/projects/cd8ca08e341c4e249bfdb06115180280 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:34.070782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:34.080426 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c89d2-a1e0-4cf0-9c8b-07b1b5f498c3 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:34.098022 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:34.140281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:34.140922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.141207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.141531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] PATH_INFO: `/v3/users/0423c27ca572404281d31e06ec602c0d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.142946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0423c27ca572404281d31e06ec602c0d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:34.144941 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:34.191463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0423c27ca572404281d31e06ec602c0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.192113 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0423c27ca572404281d31e06ec602c0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.192726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0423c27ca572404281d31e06ec602c0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.205026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0423c27ca572404281d31e06ec602c0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.212282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b6b6ffc6-f73e-4d2b-ae0b-aceeb1e903b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0423c27ca572404281d31e06ec602c0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.224425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1356/2688] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:34 2022] DELETE /identity/v3/users/0423c27ca572404281d31e06ec602c0d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:34.502111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:34.503847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:34.518595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d82c2-a934-4705-939b-62d006557b24 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:34.551837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:34.586616 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:34.587285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.587567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.587893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] PATH_INFO: `/v3/projects/a8dbe34eac2849b59db569f8cd330b00` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.589038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8dbe34eac2849b59db569f8cd330b00)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:34.590926 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:34.640216 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dbe34eac2849b59db569f8cd330b00', 'request_id': 'req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.646203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dbe34eac2849b59db569f8cd330b00', 'request_id': 'req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.652681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dbe34eac2849b59db569f8cd330b00', 'request_id': 'req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.667245 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] The token cache is being invalidate because project a8dbe34eac2849b59db569f8cd330b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:34.667534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.668152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9e05b047-19e6-473b-83b7-9c12e7d8bcb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:34.669632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1333/2689] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:34 2022] DELETE /identity/v3/projects/a8dbe34eac2849b59db569f8cd330b00 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:34.675029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.675526 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.675644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.694829 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:34.696055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:34.755677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1357/2690] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:34.763645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.763931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.764202 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.784534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:34.785722 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:34.793511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1334/2691] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:34.797591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:34.807354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9787a-cd2c-47f8-b36f-af37b2fac9d6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:34.811876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:34.812475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.812755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.813027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.814166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:23:34.814479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:34.816111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:34.827558 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1358/2692] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:23:34.832416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:34.841668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453adc7a-cfbd-4418-b37e-33ce4469e9ed None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:34.846351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:34.846939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.847246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.847515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.848165 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:34.850039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:34.876905 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1335/2693] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:34 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:23:34.881031 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:34.890631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58076629-cbd8-46ba-9134-37530c40a898 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:34.916323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:34.952397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:34.953005 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.953395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.953668 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.955191 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:34.957095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:34.977658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1359/2694] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:34 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:34.981829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:34.992351 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4f498-291b-4395-8fa7-eaa36512f75d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:34.997014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:34.997613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:34.997897 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:34.998170 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:34.998876 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.000529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.011132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1336/2695] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:35.014881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.025338 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dffce0-cccc-4c79-8589-3534803f6198 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.029898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae5f9-0998-4277-b1cf-a8cd864001cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.030486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae5f9-0998-4277-b1cf-a8cd864001cf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.030764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae5f9-0998-4277-b1cf-a8cd864001cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.031032 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae5f9-0998-4277-b1cf-a8cd864001cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.031739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae5f9-0998-4277-b1cf-a8cd864001cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.034081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae5f9-0998-4277-b1cf-a8cd864001cf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.044583 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1360/2696] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:35.049395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.059352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042333-557f-4c34-8dfb-2d9d40662e32 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.064186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.064832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.065109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.065378 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] PATH_INFO: `/v3/projects/0b63de1d0d8d4e42b181fc2a70bcc52f/users/fef7ae839d9345729233d3be75de033a/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.079787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b63de1d0d8d4e42b181fc2a70bcc52f, user_id=fef7ae839d9345729233d3be75de033a, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.082468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.095829 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1337/2697] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:35 2022] PUT /identity/v3/projects/0b63de1d0d8d4e42b181fc2a70bcc52f/users/fef7ae839d9345729233d3be75de033a/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:35.106910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.107249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.107527 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.134714 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] MFA Rules not processed for user `fef7ae839d9345729233d3be75de033a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:35.135926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:35.200157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1361/2698] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:35.205800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.261421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:35.268632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af60f03-6e51-44a6-8e11-4db23921fa59 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.274418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.275045 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.275363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.275666 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.276321 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.278212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.303777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1338/2699] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:35 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:35.308007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.319610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb40fc-480c-46f3-80fc-342aa57957d8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.373339 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.373942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.374220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.374489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.375133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.377554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.398356 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1362/2700] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:35 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:35.402294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.412933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25df-b485-4eee-979d-dcf1638119db admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.417430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.418050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.418326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.418592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.419299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.420859 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.431851 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1339/2701] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:35.435430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.445870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427522e2-c733-442a-ab57-5ad40cc90a4d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.450491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.451219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.451502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.451773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] PATH_INFO: `/v3/projects/e9288eee8a094139aefa3aa23de8b3eb/users/66bcc5f52daf4715a12d08fba49719a7/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.466749 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9288eee8a094139aefa3aa23de8b3eb, user_id=66bcc5f52daf4715a12d08fba49719a7, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.469423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.482455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1363/2702] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:35 2022] PUT /identity/v3/projects/e9288eee8a094139aefa3aa23de8b3eb/users/66bcc5f52daf4715a12d08fba49719a7/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:35.486481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.496283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cbc7-1ac9-4c06-a2e9-defbc5c6b979 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.553176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f09c0-12bc-4634-b0e2-55b06374fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.553849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f09c0-12bc-4634-b0e2-55b06374fda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.554120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f09c0-12bc-4634-b0e2-55b06374fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.554398 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f09c0-12bc-4634-b0e2-55b06374fda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.555080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f09c0-12bc-4634-b0e2-55b06374fda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.556706 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f09c0-12bc-4634-b0e2-55b06374fda3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.566827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1340/2703] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:23:35.571082 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.576468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:35.583261 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a274-a10a-486d-8620-16828158be46 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.588157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.588813 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.589093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.589367 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] PATH_INFO: `/v3/projects/e9288eee8a094139aefa3aa23de8b3eb/users/66bcc5f52daf4715a12d08fba49719a7/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.591315 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9288eee8a094139aefa3aa23de8b3eb, user_id=66bcc5f52daf4715a12d08fba49719a7, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.593934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.604622 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1364/2704] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:35 2022] PUT /identity/v3/projects/e9288eee8a094139aefa3aa23de8b3eb/users/66bcc5f52daf4715a12d08fba49719a7/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:35.614696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.614985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.615303 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.644114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] MFA Rules not processed for user `66bcc5f52daf4715a12d08fba49719a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:35.645232 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:35.717506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1341/2705] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:23:35.732183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:35.734512 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:35.802970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95540c-9b83-44c6-88c0-785684ef28b6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:35.807720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:35.808419 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:35.808768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:35.809117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:35.820906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:35.822998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:35.834162 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1365/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:36.170473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:36.180275 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb7769-655b-4ae5-a494-bbb752b1b1a5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:36.184869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66bcc5f52daf4715a12d08fba49719a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9288eee8a094139aefa3aa23de8b3eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:36.185500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:36.185782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:36.186055 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:36.186746 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:23:36.187057 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:36.189198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:36.200997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1342/2707] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:23:36.205747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:36.215454 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd116dfe-5c57-4825-89cc-a2bc1ee641d3 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:36.220183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66bcc5f52daf4715a12d08fba49719a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9288eee8a094139aefa3aa23de8b3eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:36.220822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:36.221102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:36.221373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:36.222024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:36.223981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:36.251646 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1366/2708] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:36 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:36.255751 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:36.265622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f4e6-ad72-40d7-9bf9-73e79cb77502 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:36.298948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:36.325091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66bcc5f52daf4715a12d08fba49719a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9288eee8a094139aefa3aa23de8b3eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:36.325699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:36.325985 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:36.326264 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:36.326942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:23:36.327287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:36.328930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:36.340865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1343/2709] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:23:36.379016 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:36.389198 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9ef58-441c-4c26-b205-1bfda817bfd8 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:36.394019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66bcc5f52daf4715a12d08fba49719a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9288eee8a094139aefa3aa23de8b3eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:36.394648 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:36.394933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:36.395240 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] PATH_INFO: `/v3/projects/9b32bba569a44103a99f595d28d0c91d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:36.396430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b32bba569a44103a99f595d28d0c91d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:36.398347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:36.446466 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b32bba569a44103a99f595d28d0c91d', 'request_id': 'req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.451884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b32bba569a44103a99f595d28d0c91d', 'request_id': 'req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.458824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b32bba569a44103a99f595d28d0c91d', 'request_id': 'req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.471383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] The token cache is being invalidate because project 9b32bba569a44103a99f595d28d0c91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:36.471672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.472310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ef355b79-7583-4fa0-ab8a-fd89ac58afb3 tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.473790 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1367/2710] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:36 2022] DELETE /identity/v3/projects/9b32bba569a44103a99f595d28d0c91d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:36.666363 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:36.668207 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:36.732644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847f58-70a6-4291-9bea-66b1e9868d0b tempest-VolumeQuotaClassesTest-1824053469 tempest-VolumeQuotaClassesTest-1824053469-project-admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:36.786201 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:36.786852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:36.787126 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:36.787425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] PATH_INFO: `/v3/users/fef7ae839d9345729233d3be75de033a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:36.788565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef7ae839d9345729233d3be75de033a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:36.790450 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:36.835128 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef7ae839d9345729233d3be75de033a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.835789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef7ae839d9345729233d3be75de033a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.836374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef7ae839d9345729233d3be75de033a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.843168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef7ae839d9345729233d3be75de033a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.851037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef7ae839d9345729233d3be75de033a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:36.864529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:36.871038 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1344/2711] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:36 2022] DELETE /identity/v3/users/fef7ae839d9345729233d3be75de033a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:36.875652 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:36.876087 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:36.876344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:36.895770 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:36.896966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:36.948331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:36.967503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1368/2712] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:36.974176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:36.975572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:37.035977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b69fb-014e-4187-a4db-98c55cc51ac8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:37.039571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:37.040176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:37.040451 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:37.040716 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:37.049856 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:37.051302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:37.060654 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1345/2713] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:37.336730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:37.338457 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:37.351581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec83a7-e759-4141-a17c-2886109502d4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:37.356093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:37.356728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:37.357000 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:37.357764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] PATH_INFO: `/v3/projects/0b63de1d0d8d4e42b181fc2a70bcc52f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:37.359111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b63de1d0d8d4e42b181fc2a70bcc52f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:37.361628 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:37.409091 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b63de1d0d8d4e42b181fc2a70bcc52f', 'request_id': 'req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.414486 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b63de1d0d8d4e42b181fc2a70bcc52f', 'request_id': 'req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.420702 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b63de1d0d8d4e42b181fc2a70bcc52f', 'request_id': 'req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.432564 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] The token cache is being invalidate because project 0b63de1d0d8d4e42b181fc2a70bcc52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:37.432845 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.433493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.434984 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1369/2714] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:37 2022] DELETE /identity/v3/projects/0b63de1d0d8d4e42b181fc2a70bcc52f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:37.440149 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:37.449871 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f95b-85fc-49c5-a709-caf6dc6129f2 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:37.505304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:37.505931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:37.506212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:37.506489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] PATH_INFO: `/v3/users/66bcc5f52daf4715a12d08fba49719a7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:37.507676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66bcc5f52daf4715a12d08fba49719a7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:37.509590 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:37.557466 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66bcc5f52daf4715a12d08fba49719a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.558040 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66bcc5f52daf4715a12d08fba49719a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.558637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66bcc5f52daf4715a12d08fba49719a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.566515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66bcc5f52daf4715a12d08fba49719a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.574717 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f8fd01f-0457-45f7-8b66-6f17c5b4da25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66bcc5f52daf4715a12d08fba49719a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:37.593031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1346/2715] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:37 2022] DELETE /identity/v3/users/66bcc5f52daf4715a12d08fba49719a7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:37.875142 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:37.876981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:37.893303 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4a96-185e-4bbe-8052-ae54b3aa8334 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:37.950418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:37.951060 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:37.951370 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:37.951642 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] PATH_INFO: `/v3/projects/e9288eee8a094139aefa3aa23de8b3eb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:37.952774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9288eee8a094139aefa3aa23de8b3eb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:37.955699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.004929 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9288eee8a094139aefa3aa23de8b3eb', 'request_id': 'req-9320bf19-a87c-422f-ac0b-cfd73d81ee48'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:38.010352 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9288eee8a094139aefa3aa23de8b3eb', 'request_id': 'req-9320bf19-a87c-422f-ac0b-cfd73d81ee48'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:38.016890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9288eee8a094139aefa3aa23de8b3eb', 'request_id': 'req-9320bf19-a87c-422f-ac0b-cfd73d81ee48'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:38.029660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] The token cache is being invalidate because project e9288eee8a094139aefa3aa23de8b3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:38.029942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:38.030549 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9320bf19-a87c-422f-ac0b-cfd73d81ee48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:38.033175 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1370/2716] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:37 2022] DELETE /identity/v3/projects/e9288eee8a094139aefa3aa23de8b3eb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:38.038050 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784656-b305-47c3-831f-36f31e22da76 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.038538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784656-b305-47c3-831f-36f31e22da76 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.038656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784656-b305-47c3-831f-36f31e22da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.059304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-44784656-b305-47c3-831f-36f31e22da76 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:38.060517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-44784656-b305-47c3-831f-36f31e22da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:38.074287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:38.122391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1347/2717] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:38.131220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.131510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.131779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.146097 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:38.153981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:38.155844 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:38.172593 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1371/2718] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:38.177714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784656-b305-47c3-831f-36f31e22da76 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.187705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784656-b305-47c3-831f-36f31e22da76 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.193195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.193870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.194215 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.194676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.195830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:23:38.195830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.197467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.210304 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1348/2719] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:23:38.214611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.226436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0c4f-f72a-4bf8-ae27-3e5fc3a441da None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.231071 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.231735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.232015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.232282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.232939 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.234842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.262934 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1372/2720] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:38.267258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.277068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422664-68c1-4785-8be2-81b2717e9b62 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.337455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.337965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.338253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.338526 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.339370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.341385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.362714 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1349/2721] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:38.366854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.377641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5081702-3224-4022-9804-8ad9e79d18d4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.382239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.382851 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.383134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.383546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.384233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.385824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.396155 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1373/2722] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:23:38.400094 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.413571 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8cfdf-6141-447d-a9a8-4cb224ded34a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.418224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45149f39-e50c-46b3-b587-186ab5f6bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.418835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45149f39-e50c-46b3-b587-186ab5f6bce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.419116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45149f39-e50c-46b3-b587-186ab5f6bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.419421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45149f39-e50c-46b3-b587-186ab5f6bce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.420109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45149f39-e50c-46b3-b587-186ab5f6bce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.421699 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45149f39-e50c-46b3-b587-186ab5f6bce7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.433847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1350/2723] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:23:38.438104 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.448575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258819ef-9f48-43be-85f5-4fb35978f9b7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.453368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.454791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.455075 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.455462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] PATH_INFO: `/v3/projects/8d2275aaf8ec4824b249dcfef9de0e96/users/4f799dcd7e944e0fad6c3c21fbdc159f/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.470658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2275aaf8ec4824b249dcfef9de0e96, user_id=4f799dcd7e944e0fad6c3c21fbdc159f, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.473327 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.486169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1374/2724] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:38 2022] PUT /identity/v3/projects/8d2275aaf8ec4824b249dcfef9de0e96/users/4f799dcd7e944e0fad6c3c21fbdc159f/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:38.497852 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.498142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.498418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.527089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] MFA Rules not processed for user `4f799dcd7e944e0fad6c3c21fbdc159f`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:38.528454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:38.595648 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1351/2725] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:38.600405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.664888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fea03d-8c88-432a-a4ca-1465ec28b822 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.669444 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.670172 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.670455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.670724 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.671531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.673483 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.704875 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1375/2726] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:38.706035 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.717042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301a30b-162d-4e75-b704-a42d6190507c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.729352 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:38.776794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.777403 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.777679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.777942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.778606 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.780637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.810614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1352/2727] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:38 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:23:38.816081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.829410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63a86-e716-42d5-91ce-7f7d33622569 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.834157 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.834841 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.835117 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.835447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.836127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.837848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.854312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1376/2728] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:38.855729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.866541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252180ab-7fd3-49d7-89c0-5bc1ae844ce8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.871250 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.871989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.872362 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.872644 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] PATH_INFO: `/v3/projects/4eb948dc16c0473c8fe3b9343f5bc89f/users/0c0f092702804b01a570bd893e99e6a9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.888860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb948dc16c0473c8fe3b9343f5bc89f, user_id=0c0f092702804b01a570bd893e99e6a9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.891681 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:38.905891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1353/2729] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:38 2022] PUT /identity/v3/projects/4eb948dc16c0473c8fe3b9343f5bc89f/users/0c0f092702804b01a570bd893e99e6a9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:38.911305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:38.921850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77802b-3f22-4e76-b373-ee1a47aa5279 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:38.986756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213689-9f32-45fa-bc02-0e37442c2cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:38.987422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213689-9f32-45fa-bc02-0e37442c2cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:38.987706 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213689-9f32-45fa-bc02-0e37442c2cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:38.987985 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213689-9f32-45fa-bc02-0e37442c2cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:38.988684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213689-9f32-45fa-bc02-0e37442c2cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:38.990296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213689-9f32-45fa-bc02-0e37442c2cbc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:39.000602 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1377/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:39.005490 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:39.016800 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb229ad-c7bb-42e3-bea4-307495b0b3ca admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:39.022365 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:39.023234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:39.023585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:39.024034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] PATH_INFO: `/v3/projects/4eb948dc16c0473c8fe3b9343f5bc89f/users/0c0f092702804b01a570bd893e99e6a9/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:39.026103 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb948dc16c0473c8fe3b9343f5bc89f, user_id=0c0f092702804b01a570bd893e99e6a9, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:39.028838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:39.042182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1354/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:39 2022] PUT /identity/v3/projects/4eb948dc16c0473c8fe3b9343f5bc89f/users/0c0f092702804b01a570bd893e99e6a9/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:39.053605 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:39.053888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:39.054166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:39.080380 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:39.084051 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] MFA Rules not processed for user `0c0f092702804b01a570bd893e99e6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:39.086180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:39.171687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1378/2732] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:39.185949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:39.187848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:39.249417 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab285b4-632a-4652-8651-dce625baf1ea admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:39.254167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:39.254795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:39.255077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:39.255381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:39.265529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:39.267312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:39.277437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1355/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:39.386768 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:39.397765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068cef1-32c0-4c29-a538-0e996f465bb4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:39.403054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dc2dc-d12a-484b-9d5b-95c46084cf74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:39.403710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc2dc-d12a-484b-9d5b-95c46084cf74 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:39.404081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc2dc-d12a-484b-9d5b-95c46084cf74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:39.404354 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc2dc-d12a-484b-9d5b-95c46084cf74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:39.468491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dc2dc-d12a-484b-9d5b-95c46084cf74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:39.469958 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dc2dc-d12a-484b-9d5b-95c46084cf74 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:39.480830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1379/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:39.801880 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:39.877775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f8141-b26d-440b-9278-9e9b656a3c3c service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:39.883140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:39.884886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:39.885163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:39.885431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] PATH_INFO: `/v3/users/4f799dcd7e944e0fad6c3c21fbdc159f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:39.886608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f799dcd7e944e0fad6c3c21fbdc159f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:39.888572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:39.903195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:39.950733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f799dcd7e944e0fad6c3c21fbdc159f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:39.951415 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f799dcd7e944e0fad6c3c21fbdc159f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:39.952053 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f799dcd7e944e0fad6c3c21fbdc159f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:39.963295 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f799dcd7e944e0fad6c3c21fbdc159f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:39.972697 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f799dcd7e944e0fad6c3c21fbdc159f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:39.994656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1356/2735] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:39 2022] DELETE /identity/v3/users/4f799dcd7e944e0fad6c3c21fbdc159f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:39.999765 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:40.000274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:40.000397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:40.020625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:40.021885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:40.085393 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1380/2736] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:23:40.095831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:40.097278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:40.155600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083de6cd-9049-41e5-8f7a-5a5277330eef admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:40.159690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:40.160300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:40.160577 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:40.160846 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:40.171087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:40.173416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:40.183692 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1357/2737] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:40.467625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:40.469182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:40.491552 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca5622-293d-4222-ba9c-b59f75f45cf1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:40.496427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:40.497218 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:40.497516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:40.497794 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] PATH_INFO: `/v3/projects/8d2275aaf8ec4824b249dcfef9de0e96` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:40.498983 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2275aaf8ec4824b249dcfef9de0e96)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:40.501146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:40.540243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:40.554223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2275aaf8ec4824b249dcfef9de0e96', 'request_id': 'req-03c49944-34a6-4d92-b38e-ace007a79b7f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.559697 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2275aaf8ec4824b249dcfef9de0e96', 'request_id': 'req-03c49944-34a6-4d92-b38e-ace007a79b7f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.566004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2275aaf8ec4824b249dcfef9de0e96', 'request_id': 'req-03c49944-34a6-4d92-b38e-ace007a79b7f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.578004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] The token cache is being invalidate because project 8d2275aaf8ec4824b249dcfef9de0e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:40.578286 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.579023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.580421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1381/2738] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:40 2022] DELETE /identity/v3/projects/8d2275aaf8ec4824b249dcfef9de0e96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:40.584393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:40.593758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28e94-ead7-46d9-95c0-72f3f3cbc542 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:40.649464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:40.650118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:40.650397 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:40.650672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] PATH_INFO: `/v3/users/0c0f092702804b01a570bd893e99e6a9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:40.651832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0f092702804b01a570bd893e99e6a9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:40.653766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:40.692081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:40.702078 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0f092702804b01a570bd893e99e6a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.702729 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0f092702804b01a570bd893e99e6a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.703394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0f092702804b01a570bd893e99e6a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.711340 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0f092702804b01a570bd893e99e6a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.718332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b6551249-3f9c-42c6-a759-6f17e6e8691a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0f092702804b01a570bd893e99e6a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:40.736163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1358/2739] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:40 2022] DELETE /identity/v3/users/0c0f092702804b01a570bd893e99e6a9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:41.008764 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.010256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:41.025126 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49944-34a6-4d92-b38e-ace007a79b7f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.081677 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.082305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.082581 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.082850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] PATH_INFO: `/v3/projects/4eb948dc16c0473c8fe3b9343f5bc89f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.084013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb948dc16c0473c8fe3b9343f5bc89f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.085904 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.131467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb948dc16c0473c8fe3b9343f5bc89f', 'request_id': 'req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:41.136758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb948dc16c0473c8fe3b9343f5bc89f', 'request_id': 'req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:41.143078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb948dc16c0473c8fe3b9343f5bc89f', 'request_id': 'req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:41.155206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] The token cache is being invalidate because project 4eb948dc16c0473c8fe3b9343f5bc89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:41.155492 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:41.156122 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e48c8cbf-a1d8-4b8b-bb80-56741b9bde02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:41.158686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1382/2740] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:41 2022] DELETE /identity/v3/projects/4eb948dc16c0473c8fe3b9343f5bc89f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:41.164607 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.165120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.165236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.185344 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:41.186524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:41.244405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1359/2741] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:41.253204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.253568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.253932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.273587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:41.274717 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:41.283018 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1383/2742] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:23:41.287198 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.296825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804a5f-1bb0-406b-b751-4323561d27dd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.301931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.302522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.302797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.303064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.303770 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:23:41.304072 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.305636 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.317219 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1360/2743] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 05:23:41.321601 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.330964 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427e702-b90a-4524-a8ac-f9c9b4dff7db None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.335585 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.336189 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.336472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.336742 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.337432 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.339364 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.366737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1384/2744] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:23:41 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:41.370814 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.381589 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573f32-e84c-4ab5-af98-23709d8267ce admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.438790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.439690 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.439971 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.440244 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.440895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.442811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.463327 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1361/2745] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:23:41 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:23:41.467565 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.477915 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cf7eb-c531-4c28-9b66-48974d4f7b25 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.482620 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.483320 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.483597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.483865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.484550 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.486658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.496467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1385/2746] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:41.500298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.510238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b203-b158-42e9-937a-ee3585e7b63e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.514819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c154d-78cb-4cd7-a9ed-b82ee634f1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.515428 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c154d-78cb-4cd7-a9ed-b82ee634f1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.515705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c154d-78cb-4cd7-a9ed-b82ee634f1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.515973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c154d-78cb-4cd7-a9ed-b82ee634f1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.517249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c154d-78cb-4cd7-a9ed-b82ee634f1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.518811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c154d-78cb-4cd7-a9ed-b82ee634f1b2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.529595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1362/2747] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:23:41.534453 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.544405 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c82a-bb67-4ec6-9787-befa5e94308d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.548946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.549636 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.549906 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.550156 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] PATH_INFO: `/v3/projects/7263f2b47287485ab0c259658145c401/users/d5f2a00c4cc5434595cb7dffd06a2ea2/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.558425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:41.565811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7263f2b47287485ab0c259658145c401, user_id=d5f2a00c4cc5434595cb7dffd06a2ea2, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.568967 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.583779 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1386/2748] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:23:41 2022] PUT /identity/v3/projects/7263f2b47287485ab0c259658145c401/users/d5f2a00c4cc5434595cb7dffd06a2ea2/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:41.594089 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.595220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.595425 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.621803 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] MFA Rules not processed for user `d5f2a00c4cc5434595cb7dffd06a2ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:41.622983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:41.627972 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:41.687821 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1363/2749] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:41.699543 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:41.701309 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:41.757329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e747721-3d00-4ecb-a2c5-00e444dd3ff8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:41.760885 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5bbdf-9ceb-4988-bb84-c1c83da0d37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:41.761531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5bbdf-9ceb-4988-bb84-c1c83da0d37d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:41.761792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5bbdf-9ceb-4988-bb84-c1c83da0d37d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:41.762061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5bbdf-9ceb-4988-bb84-c1c83da0d37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:41.770720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5bbdf-9ceb-4988-bb84-c1c83da0d37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:41.772183 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5bbdf-9ceb-4988-bb84-c1c83da0d37d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:41.780704 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1387/2750] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:51.684921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=24 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:51.776746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:53.149910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:53.256683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614610f7-96de-4e79-9f66-5f211908df91 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:53.261319 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:53.261947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:53.262224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:53.262495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] PATH_INFO: `/v3/users/d5f2a00c4cc5434595cb7dffd06a2ea2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:53.263678 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f2a00c4cc5434595cb7dffd06a2ea2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:53.265612 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:53.311712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f2a00c4cc5434595cb7dffd06a2ea2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.312354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f2a00c4cc5434595cb7dffd06a2ea2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.312938 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f2a00c4cc5434595cb7dffd06a2ea2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.321113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f2a00c4cc5434595cb7dffd06a2ea2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.327903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f2a00c4cc5434595cb7dffd06a2ea2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.346657 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1364/2751] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:23:53 2022] DELETE /identity/v3/users/d5f2a00c4cc5434595cb7dffd06a2ea2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:23:53.351168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:53.351651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:53.351778 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:53.399780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:23:53.400982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:53.458757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1388/2752] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:23:53.468431 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:53.470462 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:53.510900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:53.544491 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bef2e1-38ac-462f-85a5-25880c3959fb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:53.548112 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:53.548709 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:53.548986 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:53.549252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:53.558021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:53.559557 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:53.569079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1365/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:23:53.848137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:23:53.849727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:23:53.865054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5c585-70ed-4ae7-9693-9664330510ca None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:23:53.870267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:23:53.870909 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:23:53.871210 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:23:53.871530 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] PATH_INFO: `/v3/projects/7263f2b47287485ab0c259658145c401` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:23:53.872658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7263f2b47287485ab0c259658145c401)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:23:53.874525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:23:53.925611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7263f2b47287485ab0c259658145c401', 'request_id': 'req-53451b11-e30d-4a1c-a1a6-04a1be974afd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.931445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7263f2b47287485ab0c259658145c401', 'request_id': 'req-53451b11-e30d-4a1c-a1a6-04a1be974afd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.937688 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7263f2b47287485ab0c259658145c401', 'request_id': 'req-53451b11-e30d-4a1c-a1a6-04a1be974afd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.950111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] The token cache is being invalidate because project 7263f2b47287485ab0c259658145c401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:23:53.950400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.951015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-53451b11-e30d-4a1c-a1a6-04a1be974afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:23:53.952557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1389/2754] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:23:53 2022] DELETE /identity/v3/projects/7263f2b47287485ab0c259658145c401 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:24:03.565013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=16 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:03.946959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:26.604543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:24:26.606081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:26.708139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d27d65-6443-4070-98be-67242ea4801a service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:24:26.771373 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:24:26.771906 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:24:26.772191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:24:26.772467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:24:26.774261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:26.786182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:24:26.787813 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:24:26.798123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1366/2755] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:24:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:24:29.858078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:24:29.858575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:24:29.858683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:24:29.877796 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] MFA Rules not processed for user `2fa0149b879941fc8b9223ec0c4c81ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:24:29.878959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:29.935080 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1390/2756] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:24:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:24:36.793600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=67 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:39.928505 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=25 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:58.677496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:24:58.679188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:58.771088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c568-9b4a-407b-b232-403c2330f770 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:24:58.774805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:24:58.775444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:24:58.775727 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:24:58.775998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:24:58.777752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:58.788014 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:24:58.789440 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:24:58.797645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1367/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:24:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:24:58.873314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:24:58.874730 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:58.887418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21fc1-5002-44e5-9150-a962e0ac5bb5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:24:58.890935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:24:58.891572 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:24:58.891856 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:24:58.892130 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:24:58.894146 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:24:58.982616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:24:58.984111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:24:59.005940 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1391/2758] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:24:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:08.793837 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=35 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:09.002427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=46 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:34.957799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:34.959409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:35.034893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0a551-267f-4eec-b3aa-d2fdf4d79cda service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.039841 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.040493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.040879 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.041037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] PATH_INFO: `/v3/users/2fa0149b879941fc8b9223ec0c4c81ce` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.042392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa0149b879941fc8b9223ec0c4c81ce)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.044379 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.104907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa0149b879941fc8b9223ec0c4c81ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.105618 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa0149b879941fc8b9223ec0c4c81ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.106261 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa0149b879941fc8b9223ec0c4c81ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.114299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa0149b879941fc8b9223ec0c4c81ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.121694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-103e8e5c-7d10-4a6b-a306-cdf9461995a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa0149b879941fc8b9223ec0c4c81ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.140225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1368/2759] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:34 2022] DELETE /identity/v3/users/2fa0149b879941fc8b9223ec0c4c81ce => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:35.316580 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.326802 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9443c-dad2-415e-a685-bdd73624607a service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.390111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.390748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.391027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.391331 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] PATH_INFO: `/v3/projects/e2fb243acf584b9dbdef8109649bcb89` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.392463 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2fb243acf584b9dbdef8109649bcb89)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.394571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.438439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2fb243acf584b9dbdef8109649bcb89', 'request_id': 'req-41c3f15c-fd24-49fe-96f2-44297a0d003a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.444568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2fb243acf584b9dbdef8109649bcb89', 'request_id': 'req-41c3f15c-fd24-49fe-96f2-44297a0d003a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.450694 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2fb243acf584b9dbdef8109649bcb89', 'request_id': 'req-41c3f15c-fd24-49fe-96f2-44297a0d003a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.462732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] The token cache is being invalidate because project e2fb243acf584b9dbdef8109649bcb89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:35.463013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.463651 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-41c3f15c-fd24-49fe-96f2-44297a0d003a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:35.465114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1392/2760] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:35 2022] DELETE /identity/v3/projects/e2fb243acf584b9dbdef8109649bcb89 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:35.469948 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.470234 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.470511 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.517481 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:35.519106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:35.565034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:35.577649 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1369/2761] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:35.586019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.586302 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.586575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.606089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:35.607308 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:35.614963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1393/2762] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:35.618954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.629283 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7b06-582c-4a5a-99e0-0c1d15a28b87 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.633786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.634384 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.634662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.634934 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.635659 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:25:35.635958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.637546 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.649523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1370/2763] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:25:35.653600 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.663108 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ba3bc-1ea6-4b8b-b77b-1ee49352599b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.667659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.668256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.668536 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.668808 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.669491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.671422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.698559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1394/2764] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:35 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:35.702777 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.712756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f044-fdeb-4bc0-8f74-8662c1491e7f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.769265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.769799 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.770085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.770355 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.771016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.772946 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.793406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1371/2765] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:35 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:25:35.797597 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.808249 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1d979-f2a4-40e3-9af0-3274aab4cdc9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.813012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.813606 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.813884 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.814152 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.814835 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.817416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.827007 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1395/2766] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:25:35.831469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.841634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab4501-a169-4661-8989-9cf3cdf80939 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.846870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a154cd-4f1a-4ec0-a688-91318163dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.847643 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a154cd-4f1a-4ec0-a688-91318163dc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.847957 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a154cd-4f1a-4ec0-a688-91318163dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.848235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a154cd-4f1a-4ec0-a688-91318163dc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.848921 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a154cd-4f1a-4ec0-a688-91318163dc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.850500 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a154cd-4f1a-4ec0-a688-91318163dc6a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.861007 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1372/2767] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:35.866046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:35.875830 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094c50-4c22-49b1-b5f2-906dc0eb3a34 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:35.880533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:35.881176 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.881450 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.881715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] PATH_INFO: `/v3/projects/0069ba189aac4194a8143e3dd0faf9e8/users/919fb0ad8eee4250b2192b9d97b25a5c/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.896102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0069ba189aac4194a8143e3dd0faf9e8, user_id=919fb0ad8eee4250b2192b9d97b25a5c, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:35.898737 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:35.911734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1396/2768] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:35 2022] PUT /identity/v3/projects/0069ba189aac4194a8143e3dd0faf9e8/users/919fb0ad8eee4250b2192b9d97b25a5c/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:35.922294 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:35.922583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:35.922884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:35.950786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] MFA Rules not processed for user `919fb0ad8eee4250b2192b9d97b25a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:35.952046 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:36.015820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1373/2769] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:36.020998 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.050974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:36.085401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd122508-9c3c-4b34-9dc1-975465240913 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.089988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.090592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.090873 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.091145 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.091855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.093754 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.121324 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1397/2770] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:36 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:36.125386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.136011 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6f162-0db5-475e-905a-fdb8f2256414 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.184627 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:36.196013 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.196628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.196910 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.197185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.197838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.199854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.221023 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1374/2771] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:36 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:36.225893 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.236019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2cd2-fbe6-49f5-9764-e558603112d4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.240881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.241479 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.241755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.242024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.242699 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.244318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.255361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1398/2772] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:25:36.259574 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.270077 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a4d58-5765-4925-a923-53f69d3584ad admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.274757 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.275395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.275671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.275947 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] PATH_INFO: `/v3/projects/f5975a8aaf00408286136b13fd2e52fc/users/ecac36bcbcce42f78a69abe6bbf7dc7e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.290623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5975a8aaf00408286136b13fd2e52fc, user_id=ecac36bcbcce42f78a69abe6bbf7dc7e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.293287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.306463 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1375/2773] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:36 2022] PUT /identity/v3/projects/f5975a8aaf00408286136b13fd2e52fc/users/ecac36bcbcce42f78a69abe6bbf7dc7e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:36.310368 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.320926 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6dfc-3028-430c-be10-191863d81fc1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.377318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3725f0-8b72-42ff-8ad8-c57c563ac50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.378656 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3725f0-8b72-42ff-8ad8-c57c563ac50e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.378933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3725f0-8b72-42ff-8ad8-c57c563ac50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.379234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3725f0-8b72-42ff-8ad8-c57c563ac50e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.379913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3725f0-8b72-42ff-8ad8-c57c563ac50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.381493 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3725f0-8b72-42ff-8ad8-c57c563ac50e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.390959 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1399/2774] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:36.395183 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.405552 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0234-78ee-4827-a46e-4ba6024f1d45 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.410767 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.411456 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.411740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.412042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] PATH_INFO: `/v3/projects/f5975a8aaf00408286136b13fd2e52fc/users/ecac36bcbcce42f78a69abe6bbf7dc7e/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.414004 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5975a8aaf00408286136b13fd2e52fc, user_id=ecac36bcbcce42f78a69abe6bbf7dc7e, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.416679 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.426865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1376/2775] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:36 2022] PUT /identity/v3/projects/f5975a8aaf00408286136b13fd2e52fc/users/ecac36bcbcce42f78a69abe6bbf7dc7e/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:36.438366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.438649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.438919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.466670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] MFA Rules not processed for user `ecac36bcbcce42f78a69abe6bbf7dc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:36.467877 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:36.534511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1400/2776] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:36.545619 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:36.547489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:36.625923 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e09c-9f7d-482f-8e84-29407d168162 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:36.630278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d035c-3b3a-4486-8587-fff335b75f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:36.630883 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d035c-3b3a-4486-8587-fff335b75f01 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:36.631192 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d035c-3b3a-4486-8587-fff335b75f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:36.631473 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d035c-3b3a-4486-8587-fff335b75f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:36.640445 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d035c-3b3a-4486-8587-fff335b75f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:36.641865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d035c-3b3a-4486-8587-fff335b75f01 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:36.652024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1377/2777] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:37.033291 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:37.058272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:37.095504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e26b-fed9-44b5-a3f4-5c1ca95fbf00 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:37.100464 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:37.101086 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:37.101363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:37.101631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] PATH_INFO: `/v3/users/919fb0ad8eee4250b2192b9d97b25a5c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:37.102757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] RBAC: Authorizing `identity:delete_user(user_id=919fb0ad8eee4250b2192b9d97b25a5c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:37.104695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:37.150358 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919fb0ad8eee4250b2192b9d97b25a5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.150990 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919fb0ad8eee4250b2192b9d97b25a5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.151618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919fb0ad8eee4250b2192b9d97b25a5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.164573 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919fb0ad8eee4250b2192b9d97b25a5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.172546 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919fb0ad8eee4250b2192b9d97b25a5c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.185517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1401/2778] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:37 2022] DELETE /identity/v3/users/919fb0ad8eee4250b2192b9d97b25a5c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:37.190842 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:37.191334 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:37.191453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:37.211296 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:37.212487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:37.271524 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1378/2779] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:37.281382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:37.282781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:37.343025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14b986-84f7-4400-82e2-390e5a0e175d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:37.347310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:37.347987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:37.348262 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:37.348533 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:37.357553 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:37.358971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:37.369008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1402/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:37.634064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:37.635625 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:37.649167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cf74-7c87-4d5c-994b-97af69a58afd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:37.654070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:37.654782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:37.655131 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:37.655485 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] PATH_INFO: `/v3/projects/0069ba189aac4194a8143e3dd0faf9e8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:37.656720 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0069ba189aac4194a8143e3dd0faf9e8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:37.658687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:37.683695 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:37.708353 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0069ba189aac4194a8143e3dd0faf9e8', 'request_id': 'req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.713789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0069ba189aac4194a8143e3dd0faf9e8', 'request_id': 'req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.719843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0069ba189aac4194a8143e3dd0faf9e8', 'request_id': 'req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.733087 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] The token cache is being invalidate because project 0069ba189aac4194a8143e3dd0faf9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:37.733370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.734015 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.735553 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1379/2781] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:37 2022] DELETE /identity/v3/projects/0069ba189aac4194a8143e3dd0faf9e8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:37.739658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:37.749061 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1503-895f-491b-a2d9-c916ce9e28a9 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:37.790111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:37.806149 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:37.806784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:37.807066 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:37.807363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] PATH_INFO: `/v3/users/ecac36bcbcce42f78a69abe6bbf7dc7e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:37.808508 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecac36bcbcce42f78a69abe6bbf7dc7e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:37.810416 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:37.855814 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecac36bcbcce42f78a69abe6bbf7dc7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.856445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecac36bcbcce42f78a69abe6bbf7dc7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.857034 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecac36bcbcce42f78a69abe6bbf7dc7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.870095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecac36bcbcce42f78a69abe6bbf7dc7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.876660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7749429e-9d32-4c55-bf4a-b3dacdb95feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecac36bcbcce42f78a69abe6bbf7dc7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:37.889513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1403/2782] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:37 2022] DELETE /identity/v3/users/ecac36bcbcce42f78a69abe6bbf7dc7e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:38.176820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.178269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:38.193669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a6ae-c3c1-409f-b0ab-dfd1275f6d52 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.251127 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.251786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.252063 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.252331 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] PATH_INFO: `/v3/projects/f5975a8aaf00408286136b13fd2e52fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.254123 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5975a8aaf00408286136b13fd2e52fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.256118 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.301774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5975a8aaf00408286136b13fd2e52fc', 'request_id': 'req-d1559c05-bb2a-4eaa-91ab-791e9733c861'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:38.307279 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5975a8aaf00408286136b13fd2e52fc', 'request_id': 'req-d1559c05-bb2a-4eaa-91ab-791e9733c861'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:38.313591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5975a8aaf00408286136b13fd2e52fc', 'request_id': 'req-d1559c05-bb2a-4eaa-91ab-791e9733c861'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:38.326389 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] The token cache is being invalidate because project f5975a8aaf00408286136b13fd2e52fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:38.326673 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:38.327325 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d1559c05-bb2a-4eaa-91ab-791e9733c861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:38.328808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1380/2783] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:38 2022] DELETE /identity/v3/projects/f5975a8aaf00408286136b13fd2e52fc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:38.334029 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.334318 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.334592 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.353544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:38.354736 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:38.414138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1404/2784] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:38.422408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.422651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.422904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.443212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:38.444409 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:38.452309 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1381/2785] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:38.457408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.466908 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ead6c-f070-4e5a-b190-cc704c995189 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.472323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.472951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.473229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.473499 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.474182 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:25:38.474484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.476111 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.487468 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1405/2786] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:25:38.491739 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.500807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c491-3ad0-4d7c-8534-facbe3dbbd69 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.505521 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.506111 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.506390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.506662 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.507354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.509228 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.537161 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1382/2787] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:25:38.541293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.551713 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d744-ff53-4572-9a31-25f382eb0ecc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.600190 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:38.611229 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.611949 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.612655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.612924 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.613587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.615541 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.636467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1406/2788] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:38.640542 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.651520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f538e0-921d-4e5c-8a9d-396a163ae6b3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.656042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.656669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.656949 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.657220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.657904 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.659892 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.665010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:38.671001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1383/2789] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:38.675089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.685023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce46599-330c-48f1-9010-4edf435fcc72 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.690422 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358ce8b-f445-4d0b-8d50-3b6446768e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.690968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358ce8b-f445-4d0b-8d50-3b6446768e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.691284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358ce8b-f445-4d0b-8d50-3b6446768e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.691561 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358ce8b-f445-4d0b-8d50-3b6446768e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.692256 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358ce8b-f445-4d0b-8d50-3b6446768e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.693860 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358ce8b-f445-4d0b-8d50-3b6446768e24 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.704792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1407/2790] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:38.709534 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.719731 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7eb74-f72f-4b43-afc1-1e6125fa7465 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.724713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.725377 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.725661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.725939 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] PATH_INFO: `/v3/projects/60e7e7022ac448909c46d1eab5946f48/users/9e78ac76e253490198946968c3c3659c/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.742116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e7e7022ac448909c46d1eab5946f48, user_id=9e78ac76e253490198946968c3c3659c, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.744805 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.757844 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1384/2791] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:38 2022] PUT /identity/v3/projects/60e7e7022ac448909c46d1eab5946f48/users/9e78ac76e253490198946968c3c3659c/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:38.769712 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.769995 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.770268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.798206 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] MFA Rules not processed for user `9e78ac76e253490198946968c3c3659c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:38.799437 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:38.861161 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1408/2792] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:38.865641 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.928312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505d424-1e29-41bf-bd48-4dcd812ae560 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:38.932902 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:38.933508 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:38.933789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:38.934064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:38.934726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:38.936642 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:38.963246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1385/2793] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:38.967248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:38.977757 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737e3da-cc71-4a64-becf-f565d5285bcb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.032623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.033232 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.033510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.033973 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.034631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.036571 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.057313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1409/2794] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:38 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:39.061448 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:39.072645 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b58d4-eeec-4667-8cc8-f66b5e3c309d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.077163 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.077754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.078034 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.078300 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.078967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.080580 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.091132 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1386/2795] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:39.095003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:39.105234 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db441-0923-4028-99c8-f01bdc62fa49 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.109774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.110423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.110703 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.110975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] PATH_INFO: `/v3/projects/e35604974842495dac3e2f25e922c66d/users/2ad56f151af74415a46d59f6134dc07d/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.125750 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35604974842495dac3e2f25e922c66d, user_id=2ad56f151af74415a46d59f6134dc07d, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.129046 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.142213 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1410/2796] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:39 2022] PUT /identity/v3/projects/e35604974842495dac3e2f25e922c66d/users/2ad56f151af74415a46d59f6134dc07d/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:39.146458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:39.156336 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ce303-ceda-4e90-9150-882d6f4d775c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.214179 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394a2a3-84ca-48ea-9b45-8a334d4200c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.214831 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394a2a3-84ca-48ea-9b45-8a334d4200c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.214976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394a2a3-84ca-48ea-9b45-8a334d4200c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.215282 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394a2a3-84ca-48ea-9b45-8a334d4200c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.215958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394a2a3-84ca-48ea-9b45-8a334d4200c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.217523 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394a2a3-84ca-48ea-9b45-8a334d4200c4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.227108 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1387/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:39.231254 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:39.241781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0fcd-b464-432b-8986-efe4ac3cf2fb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.246281 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.246932 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.247248 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.247522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] PATH_INFO: `/v3/projects/e35604974842495dac3e2f25e922c66d/users/2ad56f151af74415a46d59f6134dc07d/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.249456 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35604974842495dac3e2f25e922c66d, user_id=2ad56f151af74415a46d59f6134dc07d, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.252944 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.262881 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1411/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:39 2022] PUT /identity/v3/projects/e35604974842495dac3e2f25e922c66d/users/2ad56f151af74415a46d59f6134dc07d/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:39.273197 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.273520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.273795 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.303350 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] MFA Rules not processed for user `2ad56f151af74415a46d59f6134dc07d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:39.304623 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:39.338919 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:39.374790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1388/2799] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:39.386582 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:39.388298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:39.403498 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:39.448531 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2854-722d-42c3-b58f-6b99a9ed53ec admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.452196 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.452803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.453089 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.453362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.462890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.464439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.473635 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1412/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:39.627994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:39.637650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce5bf5-267b-448f-b146-cb92258e9b22 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:39.641213 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a470f0-4a5d-4452-91f1-dd24269f4c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:39.641808 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a470f0-4a5d-4452-91f1-dd24269f4c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:39.642088 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a470f0-4a5d-4452-91f1-dd24269f4c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:39.642359 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a470f0-4a5d-4452-91f1-dd24269f4c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:39.699199 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a470f0-4a5d-4452-91f1-dd24269f4c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:39.700634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a470f0-4a5d-4452-91f1-dd24269f4c33 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:39.710816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1389/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:44.956922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:45.015623 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ba8d-2b90-4c6e-88c6-383e4b07a867 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:45.021310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:45.021929 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:45.022204 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:45.022472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] PATH_INFO: `/v3/users/9e78ac76e253490198946968c3c3659c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:45.023625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e78ac76e253490198946968c3c3659c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:45.025529 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:45.069853 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e78ac76e253490198946968c3c3659c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.070418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e78ac76e253490198946968c3c3659c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.071008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e78ac76e253490198946968c3c3659c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.083027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e78ac76e253490198946968c3c3659c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.090088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e78ac76e253490198946968c3c3659c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.102064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1413/2802] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:44 2022] DELETE /identity/v3/users/9e78ac76e253490198946968c3c3659c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:45.106563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:45.107097 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:45.107231 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:45.126597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:45.128869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:45.188765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1390/2803] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:45.199023 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:45.200439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:45.241085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:45.266215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7666d-7bbf-43da-a433-6b0c932755d4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:45.270333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:45.270970 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:45.271270 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:45.271542 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:45.280489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:45.281914 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:45.291283 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1414/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:45.556174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:45.557613 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:45.571952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f36b-d51c-47c4-887e-4629ca7d257d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:45.576674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:45.577312 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:45.577593 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:45.577865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] PATH_INFO: `/v3/projects/60e7e7022ac448909c46d1eab5946f48` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:45.579028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e7e7022ac448909c46d1eab5946f48)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:45.581809 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:45.631008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e7e7022ac448909c46d1eab5946f48', 'request_id': 'req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.636589 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e7e7022ac448909c46d1eab5946f48', 'request_id': 'req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.642602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e7e7022ac448909c46d1eab5946f48', 'request_id': 'req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.646156 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:45.658151 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] The token cache is being invalidate because project 60e7e7022ac448909c46d1eab5946f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:45.658437 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.659140 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.660732 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1391/2805] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:45 2022] DELETE /identity/v3/projects/60e7e7022ac448909c46d1eab5946f48 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:45.664687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:45.674975 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182bc3-4906-46f6-be55-ec0173e149b6 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:45.731099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:45.731762 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:45.732047 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:45.732323 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] PATH_INFO: `/v3/users/2ad56f151af74415a46d59f6134dc07d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:45.733475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad56f151af74415a46d59f6134dc07d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:45.735425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:45.780495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad56f151af74415a46d59f6134dc07d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.781139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad56f151af74415a46d59f6134dc07d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.781734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad56f151af74415a46d59f6134dc07d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.793848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad56f151af74415a46d59f6134dc07d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.802109 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-89ccb521-b764-460d-a512-eab623d4c1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad56f151af74415a46d59f6134dc07d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:45.814290 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1415/2806] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:45 2022] DELETE /identity/v3/users/2ad56f151af74415a46d59f6134dc07d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:46.085308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.086930 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:46.099775 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7eed-8efa-4e77-b9f1-6a329db161fa admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.156370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.156989 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.157271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.157551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] PATH_INFO: `/v3/projects/e35604974842495dac3e2f25e922c66d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.159346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35604974842495dac3e2f25e922c66d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.161238 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.208990 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35604974842495dac3e2f25e922c66d', 'request_id': 'req-8f79b848-359c-42ee-b33a-af5a0b3502e7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:46.214317 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35604974842495dac3e2f25e922c66d', 'request_id': 'req-8f79b848-359c-42ee-b33a-af5a0b3502e7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:46.220246 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35604974842495dac3e2f25e922c66d', 'request_id': 'req-8f79b848-359c-42ee-b33a-af5a0b3502e7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:46.231984 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] The token cache is being invalidate because project e35604974842495dac3e2f25e922c66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:46.232265 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:46.232874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f79b848-359c-42ee-b33a-af5a0b3502e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:46.234348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1392/2807] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:46 2022] DELETE /identity/v3/projects/e35604974842495dac3e2f25e922c66d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:46.239415 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.239900 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.239999 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.259459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:46.260718 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:46.308888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:46.322363 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1416/2808] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:46.330153 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.331051 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.331346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.350468 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:46.351685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:46.359386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1393/2809] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:46.363670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.373099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357b118-08a6-406d-8c60-d99634f9aed7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.378099 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.378700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.378981 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.379284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.379968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:25:46.380267 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.381854 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.393284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1417/2810] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:25:46.397483 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.406525 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd9b3a-0279-42b5-ab78-9c6fc87dfa20 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.411884 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.412476 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.412756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.413022 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.413664 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.415572 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.452347 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1394/2811] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:46.456373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.466271 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168f3d-9427-40c2-96b8-d68cae165165 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.521475 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.522074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.522350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.522615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.523306 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.525209 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.546192 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1418/2812] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:46.550520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.560563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbfaba-7b59-4d7b-9259-0ef9d29ffdd2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.565640 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.566235 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.566512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.566782 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.567495 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.569223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.579021 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1395/2813] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:46.583616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.593644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc37304-b78d-4f3f-8bbd-462bd1f4d860 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.598855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7c23-6809-47b6-913e-a7c919642f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.599484 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7c23-6809-47b6-913e-a7c919642f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.599759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7c23-6809-47b6-913e-a7c919642f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.600025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7c23-6809-47b6-913e-a7c919642f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.600728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe7c23-6809-47b6-913e-a7c919642f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.602333 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe7c23-6809-47b6-913e-a7c919642f64 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.612722 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1419/2814] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:46.616864 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.626754 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2ddc-66eb-45fb-9ea8-59567436254e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.632029 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.632685 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.632965 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.633237 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] PATH_INFO: `/v3/projects/f1a52450bb484b0ba19240064a5927d6/users/00bf177c296c40fb9e7bd7143d1a3810/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.648694 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a52450bb484b0ba19240064a5927d6, user_id=00bf177c296c40fb9e7bd7143d1a3810, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.651396 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.665393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1396/2815] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:46 2022] PUT /identity/v3/projects/f1a52450bb484b0ba19240064a5927d6/users/00bf177c296c40fb9e7bd7143d1a3810/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:46.730683 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.730894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.731134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.758079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] MFA Rules not processed for user `00bf177c296c40fb9e7bd7143d1a3810`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:46.759293 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:46.822090 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1420/2816] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:46.826661 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.839610 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:46.890601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024c799-a564-4e7b-8405-f2c7268a27dd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.895387 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:46.895988 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:46.896267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:46.896541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:46.897184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:46.899074 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:46.938036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1397/2817] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:46.942782 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:46.953513 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efbff-dbb9-416c-87ca-6b07dcaf3d85 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:46.998791 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:47.010120 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.010811 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.011093 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.011407 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.012081 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.014012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.036341 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1421/2818] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:46 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:25:47.040173 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:47.050586 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13b82-ef0f-49ad-89b6-8ab379fbbed5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:47.055218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.055820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.056106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.056381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.057062 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.058650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.069898 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1398/2819] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:47.074094 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:47.084919 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404cecc-0f15-43b6-9a9c-57e46f24417a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:47.089743 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.090402 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.090680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.090951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] PATH_INFO: `/v3/projects/60169045b1604a208fd1e380a3f00c6f/users/c0192da2ce2f43df80afcd57464162c3/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.105284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=60169045b1604a208fd1e380a3f00c6f, user_id=c0192da2ce2f43df80afcd57464162c3, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.107966 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.120627 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1422/2820] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:47 2022] PUT /identity/v3/projects/60169045b1604a208fd1e380a3f00c6f/users/c0192da2ce2f43df80afcd57464162c3/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:47.124683 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:47.135515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9b5d-d35e-4607-88b9-90df9df10e60 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:47.197512 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc01b2a-2a70-432a-95ce-310b3940f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.198160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc01b2a-2a70-432a-95ce-310b3940f54b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.198395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc01b2a-2a70-432a-95ce-310b3940f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.198668 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc01b2a-2a70-432a-95ce-310b3940f54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.199412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc01b2a-2a70-432a-95ce-310b3940f54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.200999 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc01b2a-2a70-432a-95ce-310b3940f54b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.211240 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1399/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:25:47.215594 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:47.225846 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682be6d-7a52-4620-9782-24de16206bbb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:47.230705 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.231411 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.231825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.232274 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] PATH_INFO: `/v3/projects/60169045b1604a208fd1e380a3f00c6f/users/c0192da2ce2f43df80afcd57464162c3/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.234662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] RBAC: Authorizing `identity:create_grant(project_id=60169045b1604a208fd1e380a3f00c6f, user_id=c0192da2ce2f43df80afcd57464162c3, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.237897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.249672 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1423/2822] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:47 2022] PUT /identity/v3/projects/60169045b1604a208fd1e380a3f00c6f/users/c0192da2ce2f43df80afcd57464162c3/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:47.260152 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.260435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.260705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.287903 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] MFA Rules not processed for user `c0192da2ce2f43df80afcd57464162c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:47.289105 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:47.359164 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1400/2823] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:47.370129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:47.371803 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:47.428629 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a40e3-f351-4973-9771-3c57ce36ddef admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:47.432242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99277e7-d2d5-4ad1-8c37-91d12282e619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.432842 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99277e7-d2d5-4ad1-8c37-91d12282e619 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.433129 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99277e7-d2d5-4ad1-8c37-91d12282e619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.433398 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99277e7-d2d5-4ad1-8c37-91d12282e619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.443103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99277e7-d2d5-4ad1-8c37-91d12282e619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.444568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99277e7-d2d5-4ad1-8c37-91d12282e619 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.454015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1424/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:47.820171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:47.828541 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:47.883430 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430ec1-7cf9-4bd5-8ee6-be7b422d4c39 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:47.887952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:47.888567 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.888845 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.889110 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] PATH_INFO: `/v3/users/00bf177c296c40fb9e7bd7143d1a3810` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.890241 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00bf177c296c40fb9e7bd7143d1a3810)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:47.892181 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:47.936447 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00bf177c296c40fb9e7bd7143d1a3810'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:47.937332 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00bf177c296c40fb9e7bd7143d1a3810'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:47.937932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00bf177c296c40fb9e7bd7143d1a3810'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:47.945506 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00bf177c296c40fb9e7bd7143d1a3810'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:47.952358 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00bf177c296c40fb9e7bd7143d1a3810'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:47.969471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1401/2825] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:47 2022] DELETE /identity/v3/users/00bf177c296c40fb9e7bd7143d1a3810 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:47.973956 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:47.974244 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:47.974520 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:47.993268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:47.994455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:48.051314 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1425/2826] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:48.061286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:48.062637 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:48.120601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82d94-24b6-4429-83c2-339538a40537 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:48.124212 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:48.124807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:48.125085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:48.125354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:48.135002 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:48.136439 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:48.145878 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1402/2827] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:48.411898 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:48.413459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:48.426167 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a7853-b84e-4a9c-a96f-98b0ee60c35c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:48.430669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:48.431353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:48.431631 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:48.431897 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] PATH_INFO: `/v3/projects/f1a52450bb484b0ba19240064a5927d6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:48.433033 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a52450bb484b0ba19240064a5927d6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:48.434933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:48.475974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:48.483353 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a52450bb484b0ba19240064a5927d6', 'request_id': 'req-96196051-f348-4850-8195-6f2f27e30fab'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.489942 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a52450bb484b0ba19240064a5927d6', 'request_id': 'req-96196051-f348-4850-8195-6f2f27e30fab'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.496077 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a52450bb484b0ba19240064a5927d6', 'request_id': 'req-96196051-f348-4850-8195-6f2f27e30fab'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.508295 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] The token cache is being invalidate because project f1a52450bb484b0ba19240064a5927d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:48.508610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.509235 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.510734 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1426/2828] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:48 2022] DELETE /identity/v3/projects/f1a52450bb484b0ba19240064a5927d6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:48.514870 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:48.525942 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8ec58-440d-4940-85a5-64273141eed2 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:48.553236 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:48.586070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:48.586628 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:48.586907 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:48.587204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] PATH_INFO: `/v3/users/c0192da2ce2f43df80afcd57464162c3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:48.588346 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0192da2ce2f43df80afcd57464162c3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:48.590252 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:48.636171 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0192da2ce2f43df80afcd57464162c3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.636827 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0192da2ce2f43df80afcd57464162c3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.637421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0192da2ce2f43df80afcd57464162c3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.644816 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0192da2ce2f43df80afcd57464162c3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.652174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98331349-586d-4eb1-ac1a-c9fdbc81272c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0192da2ce2f43df80afcd57464162c3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:48.669932 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1403/2829] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:25:48 2022] DELETE /identity/v3/users/c0192da2ce2f43df80afcd57464162c3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:48.956575 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:48.958114 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:48.971824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196051-f348-4850-8195-6f2f27e30fab admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.030455 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.031088 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.031392 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.031663 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] PATH_INFO: `/v3/projects/60169045b1604a208fd1e380a3f00c6f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.032784 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60169045b1604a208fd1e380a3f00c6f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.034774 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.080988 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60169045b1604a208fd1e380a3f00c6f', 'request_id': 'req-21a41acd-b716-4155-8a77-5971dc894c03'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:49.086423 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60169045b1604a208fd1e380a3f00c6f', 'request_id': 'req-21a41acd-b716-4155-8a77-5971dc894c03'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:49.092609 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60169045b1604a208fd1e380a3f00c6f', 'request_id': 'req-21a41acd-b716-4155-8a77-5971dc894c03'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:49.104489 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] The token cache is being invalidate because project 60169045b1604a208fd1e380a3f00c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:25:49.104775 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:49.105395 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-21a41acd-b716-4155-8a77-5971dc894c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:25:49.106892 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1427/2830] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:25:48 2022] DELETE /identity/v3/projects/60169045b1604a208fd1e380a3f00c6f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:49.112565 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.112788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.113068 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.132313 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:49.133519 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:49.193520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1404/2831] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:49.202716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.203004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.203317 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.223095 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:49.224332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:49.232410 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1428/2832] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:49.238064 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.247848 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129009b1-380e-4ad8-8ec4-b65905d61f29 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.252865 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.253464 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.253750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.254020 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.254705 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:25:49.255005 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.256622 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.268537 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1405/2833] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:25:49.272976 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.282188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363819b-48bb-4267-b54d-1e417c77b14c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.287441 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.288079 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.288359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.288658 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.289310 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.291243 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.320009 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1429/2834] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:49 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:49.324186 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.334788 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d376-88be-4327-bcd2-a1ce77859cc4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.368162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:49.395592 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.396191 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.396471 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.396742 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.397424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.399435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.419931 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1406/2835] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:49 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:49.424640 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.434746 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1e40-624e-4753-a963-60a910de0cf0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.439482 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.440085 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.440355 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.440624 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.441301 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.442876 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.452540 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1430/2836] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:49.456639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.467634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf2a8-6cea-4494-837e-9fed584357d4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.472998 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56ba97-e61b-448b-8bfc-2e874d9df2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.473602 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56ba97-e61b-448b-8bfc-2e874d9df2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.473886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56ba97-e61b-448b-8bfc-2e874d9df2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.474162 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56ba97-e61b-448b-8bfc-2e874d9df2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.474849 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56ba97-e61b-448b-8bfc-2e874d9df2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.476600 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56ba97-e61b-448b-8bfc-2e874d9df2ce admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.487395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1407/2837] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:25:49.491864 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.501753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c9220-a902-49c2-8a1d-8470e66227ed admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.506361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.507013 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.507342 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.507617 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] PATH_INFO: `/v3/projects/c826a09510e74c8692aec9f9d45ae9f2/users/1125558aff9440058585066c7d628e84/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.522335 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c826a09510e74c8692aec9f9d45ae9f2, user_id=1125558aff9440058585066c7d628e84, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.525025 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.528004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:49.540514 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1431/2838] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:49 2022] PUT /identity/v3/projects/c826a09510e74c8692aec9f9d45ae9f2/users/1125558aff9440058585066c7d628e84/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:25:49.545597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6673-bad3-4c46-9b6c-bcec63e88f97 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.546070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6673-bad3-4c46-9b6c-bcec63e88f97 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.546169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6673-bad3-4c46-9b6c-bcec63e88f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.568866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-882a6673-bad3-4c46-9b6c-bcec63e88f97 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:49.570114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-882a6673-bad3-4c46-9b6c-bcec63e88f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:49.629182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1408/2839] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:49.638659 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:49.640366 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:49.695217 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a002-057a-4640-85cd-1e9742782d08 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:49.698747 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:49.699445 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:49.699723 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:49.699993 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:49.709619 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:49.711042 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:49.720336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1432/2840] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:50.349968 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.350299 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.350603 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.378597 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] MFA Rules not processed for user `1125558aff9440058585066c7d628e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:50.379825 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:50.449019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1409/2841] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:50.453633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:50.464064 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07a85-5823-4d28-8664-7c3043549cb8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:50.468660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:50.469272 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.469554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.469855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.470507 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:50.473107 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:50.499633 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1433/2842] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:25:50 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:50.503753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:50.515230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ecc89-d1e1-4ce8-b71c-247ba6c41cde None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:50.559269 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:50.576285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:50.576894 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.577172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.577442 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.578085 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:50.580079 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:50.601102 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1410/2843] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:25:50 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:25:50.605223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:50.615902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2980182-e4da-4d6b-bf44-c4c38dcd0d41 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:50.620330 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:50.620927 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.621201 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.621467 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.622138 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:50.623756 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:50.634643 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1434/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:25:50.638564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:50.648835 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49582-dfa8-4ad3-a70c-4721e8f1f7c9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:50.653458 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:50.654109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.654390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.654665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] PATH_INFO: `/v3/projects/4a5e78905b6d48408298bab9dc382fef/users/2bc763255b834c549abdf31c2b4b37a0/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.670285 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e78905b6d48408298bab9dc382fef, user_id=2bc763255b834c549abdf31c2b4b37a0, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:50.673141 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:50.686651 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1411/2845] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:50 2022] PUT /identity/v3/projects/4a5e78905b6d48408298bab9dc382fef/users/2bc763255b834c549abdf31c2b4b37a0/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:25:50.691282 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:50.701054 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc7865-411e-4206-8b43-66c198b99b10 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:50.757150 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7988630-4adc-4c76-928f-8a03ca7637b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:50.757758 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988630-4adc-4c76-928f-8a03ca7637b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.758039 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988630-4adc-4c76-928f-8a03ca7637b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.758311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988630-4adc-4c76-928f-8a03ca7637b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.758987 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7988630-4adc-4c76-928f-8a03ca7637b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:50.760611 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7988630-4adc-4c76-928f-8a03ca7637b4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:50.771074 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1435/2846] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:25:50.775671 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:50.786036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fa174-d75c-472b-87c8-c57302b9afba admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:50.790583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb49b0-bd23-4bf2-b9b5-efa8c8123edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:50.791249 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb49b0-bd23-4bf2-b9b5-efa8c8123edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:50.791527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb49b0-bd23-4bf2-b9b5-efa8c8123edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:50.791792 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb49b0-bd23-4bf2-b9b5-efa8c8123edc admin admin] PATH_INFO: `/v3/projects/4a5e78905b6d48408298bab9dc382fef/users/2bc763255b834c549abdf31c2b4b37a0/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:50.793707 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb49b0-bd23-4bf2-b9b5-efa8c8123edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e78905b6d48408298bab9dc382fef, user_id=2bc763255b834c549abdf31c2b4b37a0, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:50.796364 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb49b0-bd23-4bf2-b9b5-efa8c8123edc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:50.806333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1412/2847] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:25:50 2022] PUT /identity/v3/projects/4a5e78905b6d48408298bab9dc382fef/users/2bc763255b834c549abdf31c2b4b37a0/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:25:51.432840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:51.433239 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:51.433519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:51.462570 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] MFA Rules not processed for user `2bc763255b834c549abdf31c2b4b37a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:51.463827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:51.516289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:51.539759 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1436/2848] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:51.551069 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:51.551467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:51.551811 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:51.572712 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] MFA Rules not processed for user `1125558aff9440058585066c7d628e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:25:51.573997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:51.632820 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1413/2849] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:25:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:25:51.645850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:51.647378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:51.719134 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcde70f-d3c7-4ec0-8a79-a1463d3c2513 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:51.725236 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:51.725855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:51.726137 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:51.726436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:51.734187 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:51.735850 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:51.744946 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1437/2850] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:51.776819 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:51.778182 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:51.834405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe524f3e-b278-44ff-8d2b-a7d0a984f18b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:51.837913 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35db16684ea4a4d9c6743bd3c094439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:51.838509 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:51.838787 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:51.839056 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:51.840791 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:51.854139 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:51.855595 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:51.866916 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1414/2851] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:25:52.388910 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:25:52.444935 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43a66-badc-4675-871c-45cf090ed9f6 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:25:52.449559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:25:52.450205 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:25:52.450610 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:25:52.450887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:25:52.452665 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:25:52.467233 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:25:52.468516 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:25:52.480260 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1438/2852] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:25:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:01.861529 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:02.475406 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=66 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:04.663224 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:04.664672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:04.721106 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506a25-d909-4a27-9375-e71d30a67c40 service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:04.724696 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:04.725302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:04.725585 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:04.725860 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:04.734854 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:04.736873 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:04.746390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1415/2853] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:14.742229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=26 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:20.243300 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:20.257132 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c0b0-46d9-4885-8dc3-0530e0b06942 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:20.265207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097e3f30073e48ec832b53d8f89d0d16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:20.266052 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:20.266452 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:20.266792 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:20.268748 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:20.283418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:20.285180 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:20.297684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1439/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:23.871544 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:23.872976 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:23.969925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbce72-4df8-4e88-b614-e49618c42e1a service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:23.976366 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:23.977001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:23.977286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:23.977560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:23.979424 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:23.991882 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:23.993507 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:24.009889 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1416/2855] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:24.510186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:24.578795 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49736a-f3d0-46c4-9449-b992081a9964 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:24.584397 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:24.585040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:24.585347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:24.585615 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] PATH_INFO: `/v3/users/1125558aff9440058585066c7d628e84` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:24.586793 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1125558aff9440058585066c7d628e84)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:24.588741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:24.635472 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1125558aff9440058585066c7d628e84'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.636123 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1125558aff9440058585066c7d628e84'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.636728 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1125558aff9440058585066c7d628e84'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.649719 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1125558aff9440058585066c7d628e84'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.657439 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1125558aff9440058585066c7d628e84'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.671173 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1440/2856] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:24 2022] DELETE /identity/v3/users/1125558aff9440058585066c7d628e84 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:24.842492 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:24.862796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd644c-5927-43e5-a32b-263ebb310971 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:24.923954 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:24.924655 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:24.924858 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:24.925113 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] PATH_INFO: `/v3/projects/c826a09510e74c8692aec9f9d45ae9f2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:24.926794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c826a09510e74c8692aec9f9d45ae9f2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:24.928756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:24.977978 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c826a09510e74c8692aec9f9d45ae9f2', 'request_id': 'req-704fc076-fe4b-482a-a2a8-90b24093d51b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.983487 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c826a09510e74c8692aec9f9d45ae9f2', 'request_id': 'req-704fc076-fe4b-482a-a2a8-90b24093d51b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:24.989933 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c826a09510e74c8692aec9f9d45ae9f2', 'request_id': 'req-704fc076-fe4b-482a-a2a8-90b24093d51b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.005073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] The token cache is being invalidate because project c826a09510e74c8692aec9f9d45ae9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:25.005561 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.006185 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.008374 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1417/2857] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:24 2022] DELETE /identity/v3/projects/c826a09510e74c8692aec9f9d45ae9f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:25.012127 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.013840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:25.027334 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a467cd5-bc6f-42e2-baa3-bf40869a8399 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.087362 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.088008 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.088289 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.088568 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] PATH_INFO: `/v3/users/2bc763255b834c549abdf31c2b4b37a0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.089772 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc763255b834c549abdf31c2b4b37a0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.091739 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.097246 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:25.141184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc763255b834c549abdf31c2b4b37a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.142350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc763255b834c549abdf31c2b4b37a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.142945 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc763255b834c549abdf31c2b4b37a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.155852 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc763255b834c549abdf31c2b4b37a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.165139 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13040ac1-8864-452e-b59c-78b36433fb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc763255b834c549abdf31c2b4b37a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.183391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1441/2858] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:25 2022] DELETE /identity/v3/users/2bc763255b834c549abdf31c2b4b37a0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:25.382223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.383886 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:25.401337 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc076-fe4b-482a-a2a8-90b24093d51b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.423408 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:25.475752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.476393 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.476672 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.476943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] PATH_INFO: `/v3/projects/4a5e78905b6d48408298bab9dc382fef` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.478091 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5e78905b6d48408298bab9dc382fef)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.480019 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.533563 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5e78905b6d48408298bab9dc382fef', 'request_id': 'req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.539669 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5e78905b6d48408298bab9dc382fef', 'request_id': 'req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.546710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5e78905b6d48408298bab9dc382fef', 'request_id': 'req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.560369 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] The token cache is being invalidate because project 4a5e78905b6d48408298bab9dc382fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:25.560653 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.561267 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7c88c5e-f472-4d75-9d09-6f7f1f39e1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:25.563031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1418/2859] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:25 2022] DELETE /identity/v3/projects/4a5e78905b6d48408298bab9dc382fef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:25.569219 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.569729 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.569863 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.589980 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:25.591285 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:25.658316 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1442/2860] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:26:25.666516 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.666874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.667255 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.687765 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:25.689065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:25.697925 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1419/2861] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:25.702203 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.713408 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70e75-c5e6-417a-b000-9974407a623a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.718004 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.718626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.718913 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.719221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.719916 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:26:25.720221 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.721865 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.736745 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1443/2862] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:26:25.737843 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.747271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd478-f16b-4847-aafe-829bf08442b5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.752010 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.752608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.752887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.753160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.753818 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.756271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.792404 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1420/2863] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:26:25 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:26:25.793515 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.804043 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2dfc-a07f-4a0d-959c-8158125fe17b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.872511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.873284 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.873630 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.873971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.874902 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.877012 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.904024 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1444/2864] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:26:25 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:26:25.908048 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.920401 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d51de-eb86-4cac-9461-8fe31482e91f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.927395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.928193 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.928573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.928943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.929753 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.931551 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.944195 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1421/2865] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:26:25.948421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:25.954169 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:25.961650 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a23c6b-6ceb-4818-bab3-fe94844d8183 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:25.968616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f328bf-3e30-44fd-99a9-48b6c7aa66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:25.969491 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f328bf-3e30-44fd-99a9-48b6c7aa66ee admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:25.970242 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f328bf-3e30-44fd-99a9-48b6c7aa66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:25.970587 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f328bf-3e30-44fd-99a9-48b6c7aa66ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:25.972298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f328bf-3e30-44fd-99a9-48b6c7aa66ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:25.974710 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f328bf-3e30-44fd-99a9-48b6c7aa66ee admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:25.989687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1445/2866] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:26:25.993874 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:26.005167 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be750a5-192a-408d-ba0e-3cea259816fd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:26.010361 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:26.011278 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:26.011688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:26.012065 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] PATH_INFO: `/v3/projects/db4e7c5f86044cec8cc0ffd1e531e8db/users/23b811a6b3aa4e0e8e8b87189b8577ee/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:26.030632 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4e7c5f86044cec8cc0ffd1e531e8db, user_id=23b811a6b3aa4e0e8e8b87189b8577ee, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:26.033416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:26.056080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1422/2867] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:26:25 2022] PUT /identity/v3/projects/db4e7c5f86044cec8cc0ffd1e531e8db/users/23b811a6b3aa4e0e8e8b87189b8577ee/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:26.060420 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:26.060707 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:26.060982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:26.103989 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] MFA Rules not processed for user `23b811a6b3aa4e0e8e8b87189b8577ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:26.105207 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:26.183735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1446/2868] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:26.197160 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:26.199016 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:26.255967 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:26.262298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96def0-b4f1-4b43-88c6-6fda4edc6cdf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:26.267109 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189598ee-460c-43f3-8993-592121d742d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:26.267703 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189598ee-460c-43f3-8993-592121d742d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:26.268320 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189598ee-460c-43f3-8993-592121d742d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:26.268983 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189598ee-460c-43f3-8993-592121d742d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:26.280286 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189598ee-460c-43f3-8993-592121d742d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:26.282037 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189598ee-460c-43f3-8993-592121d742d4 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:26.293752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1423/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:26.316497 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:26.391220 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62ac4-2222-406e-8a3a-d8fa9ff16ca2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:26.397186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:26.397918 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:26.398755 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:26.399101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] PATH_INFO: `/v3/users/23b811a6b3aa4e0e8e8b87189b8577ee` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:26.400378 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b811a6b3aa4e0e8e8b87189b8577ee)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:26.402825 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:26.464922 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b811a6b3aa4e0e8e8b87189b8577ee'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:26.465979 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b811a6b3aa4e0e8e8b87189b8577ee'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:26.466596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b811a6b3aa4e0e8e8b87189b8577ee'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:26.481870 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b811a6b3aa4e0e8e8b87189b8577ee'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:26.489781 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b811a6b3aa4e0e8e8b87189b8577ee'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:26.498503 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:26.505982 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1447/2870] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:26 2022] DELETE /identity/v3/users/23b811a6b3aa4e0e8e8b87189b8577ee => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:26.508786 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:26.509146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:26.509496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:26.529386 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:26.530601 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:26.593815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1424/2871] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:26.603535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:26.604933 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:26.666522 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634212b3-e6b8-4ab1-b0a4-682af7a3959e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:26.670752 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5379f94-80c3-4b58-a454-e71b2d0eeed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:26.671780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5379f94-80c3-4b58-a454-e71b2d0eeed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:26.671780 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5379f94-80c3-4b58-a454-e71b2d0eeed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:26.672133 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5379f94-80c3-4b58-a454-e71b2d0eeed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:26.682112 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5379f94-80c3-4b58-a454-e71b2d0eeed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:26.683679 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5379f94-80c3-4b58-a454-e71b2d0eeed2 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:26.694040 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1448/2872] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:27.008039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.009522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:27.024220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817326e6-19a6-48ad-91e4-0a0b43fc9903 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.029026 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.029670 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.030392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.030392 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] PATH_INFO: `/v3/projects/db4e7c5f86044cec8cc0ffd1e531e8db` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.031522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4e7c5f86044cec8cc0ffd1e531e8db)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.034220 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.084726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4e7c5f86044cec8cc0ffd1e531e8db', 'request_id': 'req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:27.093656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4e7c5f86044cec8cc0ffd1e531e8db', 'request_id': 'req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:27.101168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4e7c5f86044cec8cc0ffd1e531e8db', 'request_id': 'req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:27.114726 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] The token cache is being invalidate because project db4e7c5f86044cec8cc0ffd1e531e8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:27.115095 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:27.115674 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0860424-cb95-4953-98e7-aa6c2d4ceb6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:27.120794 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1425/2873] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:27 2022] DELETE /identity/v3/projects/db4e7c5f86044cec8cc0ffd1e531e8db => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:27.122438 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.122727 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.123003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.144028 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:27.145625 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:27.233544 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1449/2874] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:27.243083 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.243416 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.243682 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.284515 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:27.286797 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:27.297517 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1426/2875] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:27.302305 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.316383 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b68c1-3088-4463-bcd4-349a4517479d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.322666 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.323517 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.324186 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.324626 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.325670 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:26:27.326159 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.328556 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.346045 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1450/2876] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:26:27.348520 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.358733 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af942-19a6-4702-99fd-dfa574f3751f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.372959 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.373895 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.374964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.375535 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.376502 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.378591 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.433832 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1427/2877] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:26:27.434400 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.454003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36769d-436e-45d8-8cad-1ef47cd64e77 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.530804 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.532171 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.532525 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.532868 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.533662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.536124 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.576447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1451/2878] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:26:27.580435 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.591781 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27964-52f6-4c2a-a1a4-507d8ae6c62a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.603260 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.603908 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.604194 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.604467 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.605176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.606806 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.622274 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1428/2879] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:26:27.624312 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.652855 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c5eb1-481e-4096-85c8-b5db1a93ee0e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.657535 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.658168 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.658448 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.658720 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.659559 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.661268 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.676896 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1452/2880] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:26:27.682081 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.693488 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4ff7-506f-4dd0-a968-25d7132d37d2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.698221 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca309-c3ca-41b4-a0fe-c373b21790d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.698893 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca309-c3ca-41b4-a0fe-c373b21790d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.699214 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca309-c3ca-41b4-a0fe-c373b21790d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.699522 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca309-c3ca-41b4-a0fe-c373b21790d0 admin admin] PATH_INFO: `/v3/projects/1eb6e9d70de041bc895339e8ae84ebd0/users/0eb8c0ff2be84807a8585e356dde6b35/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.719790 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca309-c3ca-41b4-a0fe-c373b21790d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb6e9d70de041bc895339e8ae84ebd0, user_id=0eb8c0ff2be84807a8585e356dde6b35, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.722584 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca309-c3ca-41b4-a0fe-c373b21790d0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.737405 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1429/2881] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:26:27 2022] PUT /identity/v3/projects/1eb6e9d70de041bc895339e8ae84ebd0/users/0eb8c0ff2be84807a8585e356dde6b35/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:27.746894 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.748616 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:27.748838 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.749196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.749540 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.760961 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:27.777639 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:27.789783 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] MFA Rules not processed for user `0eb8c0ff2be84807a8585e356dde6b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:27.792555 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:27.835693 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9b0d8-bd3c-4816-a2fd-e83de4b32036 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.883031 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1430/2882] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:26:27.884120 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:27.921010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.921732 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.922044 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.922477 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.924788 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:27.939433 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.941687 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.953409 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1453/2883] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:27.954918 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322bf05-095c-45ba-bdd4-0b2528430f7c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:27.960333 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:27.960945 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:27.961230 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:27.961499 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:27.962176 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:27.964276 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:27.995677 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1431/2884] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:26:27.999669 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:28.010539 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2eab3-4d51-430b-8a76-0f587fad2b6b service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:28.069843 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:28.070459 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.070741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.071015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.071711 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:28.073655 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:28.095686 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1454/2885] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:26:27 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:26:28.099758 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:28.109993 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676484b-42a8-4c7f-91ef-45006999a4f5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:28.115538 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:28.116155 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.116436 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.116710 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.117395 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:28.118995 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:28.130888 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1432/2886] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:26:28.135073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:28.145682 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23667ec-09e3-4eb2-85ad-fa204238b688 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:28.152414 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:28.153166 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.153443 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.153715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] PATH_INFO: `/v3/projects/24f9ca877911421690a124bdefd0a740/users/9df4f41a2f9d415598e6bf394ded4e23/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.172361 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f9ca877911421690a124bdefd0a740, user_id=9df4f41a2f9d415598e6bf394ded4e23, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:28.175569 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:28.191026 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1455/2887] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:26:28 2022] PUT /identity/v3/projects/24f9ca877911421690a124bdefd0a740/users/9df4f41a2f9d415598e6bf394ded4e23/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:28.195582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:28.205504 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f279-c2d1-4b9b-a6f2-9ebeb83b9cf8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:28.262381 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa57125-c2f7-4fdc-bf71-63a6e98a5ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:28.262996 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa57125-c2f7-4fdc-bf71-63a6e98a5ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.263341 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa57125-c2f7-4fdc-bf71-63a6e98a5ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.263608 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa57125-c2f7-4fdc-bf71-63a6e98a5ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.264348 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa57125-c2f7-4fdc-bf71-63a6e98a5ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:28.265973 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa57125-c2f7-4fdc-bf71-63a6e98a5ea1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:28.279039 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1433/2888] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:26:28.280223 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:28.290738 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c8f14-8789-45df-92a0-982699b9c484 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:28.295430 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:28.296102 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.296384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.296662 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] PATH_INFO: `/v3/projects/24f9ca877911421690a124bdefd0a740/users/9df4f41a2f9d415598e6bf394ded4e23/roles/3508b429d46f4c67aa9e3cbb594e35e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.298618 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f9ca877911421690a124bdefd0a740, user_id=9df4f41a2f9d415598e6bf394ded4e23, role_id=3508b429d46f4c67aa9e3cbb594e35e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:28.301840 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:28.304184 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:28.314015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1456/2889] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:26:28 2022] PUT /identity/v3/projects/24f9ca877911421690a124bdefd0a740/users/9df4f41a2f9d415598e6bf394ded4e23/roles/3508b429d46f4c67aa9e3cbb594e35e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:28.325711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.326204 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.326484 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.346738 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:28.357702 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] MFA Rules not processed for user `9df4f41a2f9d415598e6bf394ded4e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:28.358887 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:28.430390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1434/2890] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:28.441436 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:28.444519 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:28.506226 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf698fbb-a576-4346-8740-26a5146f8f5b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:28.509890 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:28.510502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:28.510785 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:28.511059 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:28.570058 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:28.571554 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:28.580604 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1457/2891] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:31.062385 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.063807 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.138997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551b2e2-2cea-48e2-83cb-2bda1c26c597 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.143774 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:31.144418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.145184 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.146036 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] PATH_INFO: `/v3/users/5c6c98a87bfb4fafab9315c18630881f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.147503 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6c98a87bfb4fafab9315c18630881f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:31.149650 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:31.174660 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.192895 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752806-289f-4874-a303-9377bb5ff530 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.198427 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:31.199222 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.199509 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.199786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] PATH_INFO: `/v3/users/0eb8c0ff2be84807a8585e356dde6b35` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.200952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb8c0ff2be84807a8585e356dde6b35)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:31.202887 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:31.209455 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6c98a87bfb4fafab9315c18630881f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.210099 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6c98a87bfb4fafab9315c18630881f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.210688 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6c98a87bfb4fafab9315c18630881f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.220253 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6c98a87bfb4fafab9315c18630881f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.227952 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a312b04-9123-4241-a9b9-c87c802e4d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6c98a87bfb4fafab9315c18630881f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.248073 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1435/2892] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/users/5c6c98a87bfb4fafab9315c18630881f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:31.274557 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb8c0ff2be84807a8585e356dde6b35'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.275143 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb8c0ff2be84807a8585e356dde6b35'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.275888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb8c0ff2be84807a8585e356dde6b35'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.288435 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb8c0ff2be84807a8585e356dde6b35'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.295847 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb8c0ff2be84807a8585e356dde6b35'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.309230 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1458/2893] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/users/0eb8c0ff2be84807a8585e356dde6b35 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:31.314196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.314196 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.314457 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.335146 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:31.336454 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.344750 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:31.398793 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1436/2894] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:31.409350 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.411101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.435287 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.437188 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.437911 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:31.452339 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f5a5-24c2-4e28-9d82-3e19027e6696 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.458223 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:31.458866 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.459142 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.459489 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] PATH_INFO: `/v3/projects/6e6193f6238342cb968fa7b7a2d72eaa` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.460763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6193f6238342cb968fa7b7a2d72eaa)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:31.463493 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:31.480848 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4bfa-2f5b-4913-b826-966de26f0c7a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.484644 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:31.485349 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.485698 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.486038 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.496359 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:31.497974 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:31.508215 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1459/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:31.513656 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6193f6238342cb968fa7b7a2d72eaa', 'request_id': 'req-de126c4e-484a-4ee1-8e1e-12894092f42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.519342 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6193f6238342cb968fa7b7a2d72eaa', 'request_id': 'req-de126c4e-484a-4ee1-8e1e-12894092f42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.526991 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6193f6238342cb968fa7b7a2d72eaa', 'request_id': 'req-de126c4e-484a-4ee1-8e1e-12894092f42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.541997 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] The token cache is being invalidate because project 6e6193f6238342cb968fa7b7a2d72eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:31.542289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.543427 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.545469 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1437/2896] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/projects/6e6193f6238342cb968fa7b7a2d72eaa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:26:31.555010 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.567992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f392b-6c10-4650-8811-7a762d002fe2 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.626511 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:31.627504 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.628078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.628431 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] PATH_INFO: `/v3/users/adee5388d6fe41e2bf09df26c8c925da` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.630384 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adee5388d6fe41e2bf09df26c8c925da)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:31.632421 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:31.692237 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adee5388d6fe41e2bf09df26c8c925da'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.692952 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adee5388d6fe41e2bf09df26c8c925da'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.693579 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adee5388d6fe41e2bf09df26c8c925da'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.705838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adee5388d6fe41e2bf09df26c8c925da'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.714391 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adee5388d6fe41e2bf09df26c8c925da'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.728344 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1460/2897] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/users/adee5388d6fe41e2bf09df26c8c925da => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:26:31.787093 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.788560 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.815390 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126c4e-484a-4ee1-8e1e-12894092f42d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.874543 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:31.875208 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:31.875496 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:31.875769 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] PATH_INFO: `/v3/projects/1eb6e9d70de041bc895339e8ae84ebd0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:31.876951 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb6e9d70de041bc895339e8ae84ebd0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:31.878840 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:31.910954 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.912726 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.929205 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:31.940169 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb6e9d70de041bc895339e8ae84ebd0', 'request_id': 'req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.941562 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a80d3-8112-4126-a873-37fb85030e44 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:31.947114 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb6e9d70de041bc895339e8ae84ebd0', 'request_id': 'req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.953869 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb6e9d70de041bc895339e8ae84ebd0', 'request_id': 'req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.966711 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] The token cache is being invalidate because project 1eb6e9d70de041bc895339e8ae84ebd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:31.967001 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.967624 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:31.969116 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1438/2898] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/projects/1eb6e9d70de041bc895339e8ae84ebd0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:31.973080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:31.974766 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:31.985735 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:32.013928 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:32.014667 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.014948 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.015257 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] PATH_INFO: `/v3/projects/59cf2b33f1604cbc85ea4c250070795b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.016396 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cf2b33f1604cbc85ea4c250070795b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:32.018298 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:32.048024 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4370-14bf-4ce6-ad1a-3cd495afe3ab admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:32.053776 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:32.054418 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.054701 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.054977 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] PATH_INFO: `/v3/users/9df4f41a2f9d415598e6bf394ded4e23` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.056218 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df4f41a2f9d415598e6bf394ded4e23)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:32.058172 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:32.068971 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cf2b33f1604cbc85ea4c250070795b', 'request_id': 'req-ce90139a-8622-4009-8705-7d4fba7a2b59'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.074447 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cf2b33f1604cbc85ea4c250070795b', 'request_id': 'req-ce90139a-8622-4009-8705-7d4fba7a2b59'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.080596 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cf2b33f1604cbc85ea4c250070795b', 'request_id': 'req-ce90139a-8622-4009-8705-7d4fba7a2b59'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.092424 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] The token cache is being invalidate because project 59cf2b33f1604cbc85ea4c250070795b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:32.092786 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.093336 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.094824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1461/2899] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/projects/59cf2b33f1604cbc85ea4c250070795b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:26:32.116693 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df4f41a2f9d415598e6bf394ded4e23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.117383 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df4f41a2f9d415598e6bf394ded4e23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.118080 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df4f41a2f9d415598e6bf394ded4e23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.129891 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df4f41a2f9d415598e6bf394ded4e23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.138130 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f310b561-ef76-4fc8-bebb-32cb1747c9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df4f41a2f9d415598e6bf394ded4e23'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.156564 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1439/2900] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:31 2022] DELETE /identity/v3/users/9df4f41a2f9d415598e6bf394ded4e23 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:26:32.462382 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:32.464806 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:32.534055 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90139a-8622-4009-8705-7d4fba7a2b59 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:32.592502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:32.593078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.593365 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.593641 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] PATH_INFO: `/v3/projects/24f9ca877911421690a124bdefd0a740` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.594882 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f9ca877911421690a124bdefd0a740)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:32.596899 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:32.621878 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:32.650313 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f9ca877911421690a124bdefd0a740', 'request_id': 'req-8cc3c552-142e-42dc-8857-ed2b2b3398e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.656119 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f9ca877911421690a124bdefd0a740', 'request_id': 'req-8cc3c552-142e-42dc-8857-ed2b2b3398e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.663591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f9ca877911421690a124bdefd0a740', 'request_id': 'req-8cc3c552-142e-42dc-8857-ed2b2b3398e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.677574 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] The token cache is being invalidate because project 24f9ca877911421690a124bdefd0a740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:32.677889 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.678826 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8cc3c552-142e-42dc-8857-ed2b2b3398e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:32.680649 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1462/2901] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:32 2022] DELETE /identity/v3/projects/24f9ca877911421690a124bdefd0a740 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:26:32.685676 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.685958 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.686229 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.707956 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:32.709302 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:32.752614 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:32.771713 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1440/2902] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:26:32.779532 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.779824 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.780101 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.800069 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:32.801311 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:32.809015 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1463/2903] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:32.813298 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:32.823028 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc523-c397-4a03-a23a-01e180400a5e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:32.827634 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:32.828225 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.828505 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.828772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.829446 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 05:26:32.829740 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:32.831326 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:32.843474 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1441/2904] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 05:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 05:26:32.847695 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:32.857329 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e5c4e-c8fc-4e34-9094-58b553ba7f5b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:32.861888 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:32.862476 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.862753 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.863019 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.863741 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:32.865773 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:32.892078 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1464/2905] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 05:26:32 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 05:26:32.896772 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:32.906582 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7857-4210-49b5-a631-439c210825b8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:32.963148 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:32.963789 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:32.964070 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:32.964345 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:32.965008 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:32.966943 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:32.990367 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1442/2906] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 05:26:32 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 05:26:32.994645 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:33.005296 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d43c99-11fc-41b8-9c89-1b8156b84950 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:33.009827 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:33.010425 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:33.010700 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:33.010969 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:33.011680 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:33.013259 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:33.023740 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1465/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 05:26:33.027763 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:33.037872 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a088d-a5f3-4c8d-9225-a87c7b7470f9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:33.042406 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9fab-a7fa-444d-8072-02bab4074ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:33.042994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9fab-a7fa-444d-8072-02bab4074ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:33.043311 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9fab-a7fa-444d-8072-02bab4074ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:33.043583 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9fab-a7fa-444d-8072-02bab4074ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:33.044258 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d9fab-a7fa-444d-8072-02bab4074ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:33.045839 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d9fab-a7fa-444d-8072-02bab4074ca5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:33.056370 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1443/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 05:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 05:26:33.060548 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:33.071347 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1636594-ad16-4c9d-b3a5-10c85e5a2fc0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:33.076073 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:33.076715 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:33.076992 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:33.077264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] PATH_INFO: `/v3/projects/49db1c6e2fb44e5880e725df96055487/users/05749ee6fdb04e47a917d78c64311387/roles/ba3e5daf3db54f9d86f49e343563059f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:33.091822 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49db1c6e2fb44e5880e725df96055487, user_id=05749ee6fdb04e47a917d78c64311387, role_id=ba3e5daf3db54f9d86f49e343563059f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:33.094495 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:33.107481 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1466/2909] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 05:26:33 2022] PUT /identity/v3/projects/49db1c6e2fb44e5880e725df96055487/users/05749ee6fdb04e47a917d78c64311387/roles/ba3e5daf3db54f9d86f49e343563059f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 05:26:33.117576 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:33.118066 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:33.118168 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:33.146527 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] MFA Rules not processed for user `05749ee6fdb04e47a917d78c64311387`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:33.147796 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:33.212271 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1444/2910] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 05:26:33.222903 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:33.225068 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:33.283003 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe93b-d5e2-415f-b8af-1a1aad33ee13 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:33.287214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c96d95-2f30-4407-b915-3a9a03ada0c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ec934145884311899c8ebd19082646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:33.287823 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c96d95-2f30-4407-b915-3a9a03ada0c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:33.288103 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c96d95-2f30-4407-b915-3a9a03ada0c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:33.288373 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c96d95-2f30-4407-b915-3a9a03ada0c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:33.296404 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c96d95-2f30-4407-b915-3a9a03ada0c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:33.297828 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c96d95-2f30-4407-b915-3a9a03ada0c7 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:33.307027 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1467/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:43.209453 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:43.302951 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:43.332421 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:43.401573 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfea85-75d4-4ab3-98c9-a3cc15675c46 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:43.406354 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:43.406994 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:43.407308 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:43.407588 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] PATH_INFO: `/v3/users/05749ee6fdb04e47a917d78c64311387` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:43.408756 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] RBAC: Authorizing `identity:delete_user(user_id=05749ee6fdb04e47a917d78c64311387)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:43.410687 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:43.467822 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05749ee6fdb04e47a917d78c64311387'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:43.468847 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05749ee6fdb04e47a917d78c64311387'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:43.469764 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05749ee6fdb04e47a917d78c64311387'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:43.479042 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05749ee6fdb04e47a917d78c64311387'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:43.486501 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05749ee6fdb04e47a917d78c64311387'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:43.504900 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1445/2912] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 05:26:43 2022] DELETE /identity/v3/users/05749ee6fdb04e47a917d78c64311387 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:43.510214 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:43.510591 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:43.510871 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:43.533418 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] MFA Rules not processed for user `2e4c5eb5f64b47918bbb844c3d24e88a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 05:26:43.535502 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:43.596462 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1468/2913] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 05:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 05:26:43.605966 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:43.607412 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:43.669665 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045282-5f76-4c0d-9311-bb0e9546abff admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:43.673289 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b9b3ac8ed94fc1831476c8d41323b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:43.673896 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:43.674174 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:43.674441 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:43.683394 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:43.684815 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:43.695033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1446/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:26:43.966401 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:26:43.967968 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:26:43.979799 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eff6e-4fc3-4961-9f3d-525dba108190 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:26:43.984470 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e4c5eb5f64b47918bbb844c3d24e88a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c86c1e82858454b999fb55324c5aeed', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:26:43.986035 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:26:43.986332 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:26:43.986614 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] PATH_INFO: `/v3/projects/49db1c6e2fb44e5880e725df96055487` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:26:43.987838 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49db1c6e2fb44e5880e725df96055487)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:26:43.991264 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:26:44.039716 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49db1c6e2fb44e5880e725df96055487', 'request_id': 'req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:44.045188 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49db1c6e2fb44e5880e725df96055487', 'request_id': 'req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:44.051276 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49db1c6e2fb44e5880e725df96055487', 'request_id': 'req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:44.063684 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] The token cache is being invalidate because project 49db1c6e2fb44e5880e725df96055487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 05:26:44.063963 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:44.064577 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8f0f79a9-6fbd-4b59-8fef-78f506fc44c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 05:26:44.066056 dv-cinder-815582-14-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1469/2915] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 05:26:43 2022] DELETE /identity/v3/projects/49db1c6e2fb44e5880e725df96055487 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 05:26:53.690203 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:54.060510 dv-cinder-815582-14-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:29:56.302301 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 05:29:56.303752 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:29:56.373391 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d673e6-8818-4134-9aad-5f9d3ca3e104 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 05:29:56.431964 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5402629299ee411d988f130f03dbcfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35a66bcc751f400ca1a0f307f6bef50e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 05:29:56.433166 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 05:29:56.433444 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 05:29:56.433715 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 05:29:56.435531 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 05:29:56.446830 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 05:29:56.449090 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f621f4-a460-4105-bdc8-b6038e2b846b service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 05:29:56.459033 dv-cinder-815582-14-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1447/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 05:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 05:30:06.454801 dv-cinder-815582-14-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=58 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}